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Dear Colleague: 

Much has been written lately about schoolwide programs, those efforts that promise to 
improve student learning by changing the entire school. Most of the prose describing these 
approaches remains uncomfortably silent about their effectiveness. 

And that’s what brought a group of us together: the need for our collective memberships 
to determine what works, and what just holds promise, among the variety of schoolwide 
approaches now available for adoption. 

This report examines the claims for 24 schoolwide approaches. It draws on the expertise 
of the American Institutes for Research (AIR), an independent, internationally recognized 
research organization. First, the approaches to be examined were identified; then AIR was 
asked to rate their effectiveness in raising student achievement and to describe the approaches 
along a number of dimensions. 

Due to the nature of this review, quantitative achievement measures are highlighted. This 
is not to discount the validity of qualitative research or the importance of such outcomes as a 
more positive school atmosphere and increased student satisfaction. However, it is through 
measurable achievement outcomes — test scores, grades, graduation rates — that students and 
their schools are held accountable. Thus, before agreeing to launch a large-scale reform, most 
school staffs, parents, and policymakers want to know the probability that students will benefit 
in measurable ways. 

This review found that only a few approaches have documented their positive effects on 
student achievement. Several approaches appear to hold promise, but lack evidence to verify 
this conclusion. In some cases, this lack of evidence is understandable: the approach is just too 
new to have collected the necessary data. In other cases, the approach’s developers and the 
school systems that use it never got around to conducting a systematic evaluation. These 
approaches may still be effective; that being the case, we can only hope that rigorous 
evaluations of their effectiveness occur soon. 

This complicated exercise introduced us to excellent developers, enlightened policy- 
makers, and courageous educators. Together they are improving educational opportunities for 
children. But it also introduced us to two challenges that confront those concerned about 
educational improvement. 

First, the nation’s educational research and development enterprise needs to be 
strengthened. More research is needed, to be sure. But just as important, the federal 
government should invest more in what is known as programmatic research and development. 
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Further, private industry should share this enormous responsibility by investing in ongoing 
research as well as engaging in the development of school reform programs. That is, funds are 
badly needed to enable researchers and developers to build on new knowledge to create 
schoolwide approaches that integrate curriculum, instruction, assessment, and professional 
development. Some of the 24 approaches we examined emerged from such a process. More 
are needed. 

Second, once they have been introduced in schools, approaches need to be studied 
carefully over time to determine their effectiveness. Before making adoption decisions, 
educators should have sufficient data to answer such basic questions as: Does this approach 
raise achievement as its developer claims? Is it compatible with state and districtwide reform 
initiatives? With which groups of students does it get the best results? Are most school staffs 
able to use it as designed? Can it be implemented at a reasonable cost? What kind of 
implementation support does the developer provide? 

No reform will work everywhere every time. But if we could get answers to these 
questions, everyone would know which approaches constitute their “best bets.” Educators 
could then significantly increase the odds of choosing a successful approach that addresses 
their students’ most pressing needs. At the same time, teachers and administrators also would 
know which developers provide the kind of assistance needed to implement their approaches 
successfully. 

While more work needs to be done, we believe this initial in-depth review allows us to 
suggest that school systems do have choices, and good ones at that, when it comes to 
improving student achievement. We urge our members to read this report. We believe it can be 
the catalyst for meaningful discussion among educators, administrators, and parents as they go 
about the challenges of improving the performance of their schools. 

In the meantime, we pledge at the national level to continue our advocacy for more 
approaches that can demonstrate their ability to help improve teaching and learning. 

Sincerely, 






Paul D. Houston 
Executive Director 
American Association of 
School Administrators 



Sandra Feldman 
President 

American Federation 
of Teachers 



Samuel G. Sava 
Executive Director 
National Association of 
Elementary School Principals 
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Thomas F. Koerner 
Executive Director 
National Association of 
Secondary School Principals 
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Robert Chase 
President 
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Overview 



This guide was prepared for educators and oth- 
ers to use when investigating different ap- 
proaches to school reform. It reviews the research 
on 24 “whole-school,” “comprehensive,” or 
“schoolwide” approaches.^ 

Schoolwide reform is an increasingly popular 
school improvement strategy, especially for low- 
performing, high-poverty schools. In 1994, the 
U.S. Congress made it easier for schools to orga- 
nize themselves in this way. For the first time, 
schools with student poverty rates as low as 50 
percent could use Title 1 funds to improve the 
entire school.^ Then, in 1997, Congress autho- 
rized an additional $145 million per year to help 
low-performing (mostly Title 1) schools raise stu- 
dent achievement by adopting “research-based, 
schoolwide” approaches.^ 

Thousands of schools across the country have 
begun to consider schoolwide reform seriously. 
Unfortunately, it is difficult for these schools to 
obtain accurate, objective information they can 
use to decide whether schoolwide reform is right 
for them and, if so, which approaches are most 
likely to meet their needs. This guide provides 
that information. 

While several reports catalog available schoolwide 
approaches, and some even provide limited evalu- 
ations, this is the only guide that rates the ap- 
proaches against a common set of high standards 
or compares them to one another in terms of sci- 
entifically reliable evidence. This work was con- 
ducted by the American Institutes for Research 
(AIR) under contract to the American Associa- 
tion of School Administrators, American Federa- 
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tion of Teachers, National Association of Elemen- 
tary School Principals, National Association of 
Secondary School Principals, and National Edu- 
cation Association. These organizations used an 
open, competitive process to select AIR."^ The 
sponsoring organizations set the scope for the 
original project and, with the scientific advisors, 
provided feedback on the methodology. AIR con- 
ducted the ratings independently. 

An at-a-glance summary of all 24 approaches 
opens the guide. This one-page table provides a 
snapshot of the approaches’ relative strengths in 
three areas: (a) evidence of positive effects on stu- 
dent achievement; (b) support developers pro- 
vide schools as they adopt the approaches; and 
(c) first-year adoption costs. 

Brief profiles of the approaches follow. Each pro- 
file explains the ratings the approach received, 
provides additional information about its key fea- 
tures, and includes the name and address of its 
developer. 

The guide s reference section lists papers, articles, 
and books about the approaches and their effec- 
tiveness. In Appendices A through G, readers will 
find detailed information on the procedures AIR 
used to review and rate the approaches, plus tables 
that provide additional information about each 
approach’s effects on student achievement, imple- 
mentation, and costs. 

This guide is not meant to endorse, favor, or 
discredit any of the approaches. Rather, it is 
designed to assist readers who want to critically 
examine the most widely available schoolwide 
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reform approaches. Schools can improve their 
performance in a variety of ways, not just by using 
a schoolwide approach. However, educators 
interested in these approaches should find the 
guide useful. 

TWENTY-FOUR SCHOOL REFORM 
APPROACHES AT A GLANCE 

The table on page 4 summarizes the reviews of 
all 24 schoolwide approaches. 

The information it provides is limited. To fully 
understand the ratings, readers are encouraged 
to review the profiles. The table provides a snap- 
shot of the information that was available at the 
time this guide was prepared. Developers con- 
tinue to modify and strengthen the approaches 
and to gather and report information on their 
effectiveness. 

READING THE TABLE 

The table presents information in five areas: evi- 
dence of positive effects on student achievement; 
year each approach was introduced in schools; 
number of schools using the approaches; support 
developers provide schools; and first-year adop- 
tion costs (high and low estimates). 

Approaches are rated in two of these areas: evi- 
dence of positive effects on student achievement, 
and support developers provide schools. A full 
circle (0) indicates a strength. An empty circle 
(O) indicates a weakness. The half-filled circle 
O) suggests promise, and the quarter circle ((^) 
indicates a marginal rating. The question mark 
(?) indicates that the research evidence is so lim- 
ited that there really is no evidence on which to 
assess effects on student achievement or the sup- 
port the developer provides schools. 

The table can be read by rows and by columns. 
For example, the row on Support Developer Pro- 
vides Schools indicates that the developers of 12 
approaches provide schools with “strong” imple- 
mentation support. Ten developers provide “prom- 



ising” support for implementation, and two pro- 
vide “marginal” support. 

The columns in the table provide an at-a-glance 
summary of each approach. For example, the 
column on Core Knowledge indicates that 
schools have used this approach since 1990. 
There are currently 750 Core Knowledge 
schools. A review of the studies that have ex- 
amined Core Knowledge schools indicates it 
has “promising” evidence of effects on student 
achievement, provides schools with “promising” 
support for implementation, and is moderately 
expensive to put in place. 

To the right side of the table, the column on 
Talent Development High School indicates that 
ten schools are using this approach, which was 
first introduced to schools in 1994. Studies of 
Talent Development High School show “mar- 
ginal” evidence of effects on students and 
“strong” support provided by the developer for 
implementation. Costs to adopt this approach 
are moderate. 

UNDERSTANDING THE RATINGS 

Evidence of Positive Effects on Student 
Achievement. The first row of the table presents 
ratings for Evidence of Positive Ejfects on Student 
Achievement. Each approach is rated on a five- 
point scale ranging from “strong” evidence of 
positive effects to a “no research” rating, which 
indicates there are no rigorous studies on which 
to judge the approach’s effects on student achieve- 
ment. Each rating is explained in the key on page 
3, and discussed in detail in Appendix A. 

The ratings were compiled from individual re- 
views of available studies, each of which was 
ranked according to methodological criteria such 
as sample size, duration of the study, appropri- 
ateness of comparison groups, and relevance of 
measurement instruments. 

In general, evidence of positive effects on stu- 
dent achievement — arguably the most important 
feature of any reform approach — is extremely lim- 
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ited. Even though many of the approaches have 
been in schools for years, only three provide 
strong evidence of positive effects on student 
achievement. As a result, educators often are con- 
sidering schoolwide reform without vital infor- 
mation on which to make decisions. More rigor- 
ous evaluations are needed, with broad dissemi- 
nation of findings.^ 



Support Developer Provides Schools. The 

fourth row of the table presents ratings for the 
Support Developer Provides Schools, This four- 
point rating ranges from strong implementation 
support, in which developers provide a range of 
services, to weak support, in which developers 
only provide initial training for school staffs. 
Higher ratings indicate that the developers pro- 
vide access to appropriate types of support, fre- 



Ratings of Evidence of Positive Effects on Student Achievement 

^ = Strong evidence of positive effects on student achievement 

A strong rating indicates that four or more studies, using rigorous methodologies, show some 
positive effects on student achievement,^ with at least three of such studies showing effects that 
are educationally (or statistically) significant. Further, only 20 percent of studies show negative 
or no effects on students. To ensure enough information for future replications, at least one 
study provides information on implementation as well as on effects. 

3= Promising evidence of positive effects on student achievement 

A promising rating indicates that three or more studies, using rigorous methodologies, show 
positive effects of the approach on student achievement, with at least one such study showing 
effects at statistically or educationally significant levels. No more than 30 percent of studies 
show negative or no effects on students, and at least one study provides information on imple- 
mentation. Evidence that is rated as promising, rather than strong, may include fewer studies 
using rigorous methodologies, fewer studies showing significant effects, or a higher proportion 
of studies showing negative or no effects. 



= Marginal evidence of positive effects on student achievement 

A marginal rating indicates that at least one study, using rigorous methodology, shows positive 
effects of the approach on student achievement. At least 50 percent of studies show positive 
effects on student achievement. Evidence that is rated marginal rather than promising may 
include fewer studies using rigorous methodologies, fewer studies showing significant effects, 
or a higher proportion of studies showing negative or no effects. 



Q = Evidence of mixed, weak, or no effects on student achievement 

A mixed, weak, or no effects rating indicates that at least one study, using rigorous methodology, 
shows negative or no effects of the approach on student achievement. Evidence that is rated 
mixed, weak, or no effects rather than marginal m.ay include the same numb^ 
studies, but the findings are negative or ambiguous rather than positive. 






? = No research on effects on student achievement 

A no research rating indicates there are no methodologically rigorous studies by which to assess 
effects of the approach on student achievement. 



24 Schoolwide Reform Approaches at a Glance 
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EXPLANATION OF “24 SCHOOLWIDE REFORM APPROACHES AT A GLANCE” TABLE 

Evidence of positive effects on student achievement: To arrive at this rating, studies that report achievement eflFects were reviewed. The studies 
report student achievement on: standardized tests, including mandated statewide assessments; assessments embedded in a specific curriculum; 
teacher-designed assessments; reading inventories; and the National Assessment of Educational Progress. Evidence of effects on achievement also 
includes students’ course-taking patterns; daily attendance rates; graduation rates; within-grade retention rates; and letter grades. The final rating 
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quent support over an extended time, and tools 
to help schools evaluate implementation.^ 

Each rating is explained in the key belo\v, and 
discussed in detail in Appendix D. 

It is important to note, however, that some de- 
velopers may not provide extensive support be- 
cause schools do not need it to implement a par- 
ticular approach successfully. To get a full pic- 
ture of what kinds of changes are required of 
schools and what kinds of support are offered, 
readers should compare profiles. 

UNDERSTANDING THE CONTEXT FOR 
THE RATINGS 

The table provides contextual information about 
the approaches in three areas: the year each ap- 
proach was first introduced in schools, the num- 
ber of schools using each approach, and first-year 
adoption costs. 



Year Introduced in Schools. The second row of 
the table shows the year each approach was first 
introduced in schools. This information provides 
some context for interpreting findings. Depend- 
ing on the approach, it may take three years to 
fully implement and an additional two years to 
evaluate. Approaches that have been in schools 
for five or fewer years may have lower ratings for 
Evidence of Positive Effects on Student Achievement 
than approaches that have operated in schools 
for some time because there has not been a suffi- 
cient period of time for such data to be collected. 

Number of Schools. The third row shows the 
number of schools across the country that had 
implemented the approaches as of fall 1998 . 
These are the schools that each developer re- 
ports are using their entire approach; it does not 
include schools that only use materials or imple- 
ment selected components of an approach. 



Ratings of Support Developer Provides Schools 

^ = Strong implementation support 

A strong rating indicates that the developer ensures that schools receive frequent on-site technical 
assistance; a variety of types of support; support for the full implementation period (i.e., three 
years); and guidance in developing the tools to manage implementation locally. 

(3 = Promising implementation support 

A promising rating indicates that the developer ensures that schools receive some on-site technical 
assistance; a variety of types of support; and support for the full implementation period. Support 
that is rated promising rather than strong may have less frequent on-site support, less variety in types 
of support, and/or no help developing tools for managing implementation locally. 

= Marginal implementation support 

A marginal rating indicates that the developer provides a variety of support in response to schools’ 
requests for at least one year of implementation. Support that is rated marginal rather promis- 
ing may provide support in response to requests, rather than ensuring that dl schools receive at least 
a minimum amount of support, and/or may provide support for less than three years. 

O = Weak implementation support 

A weak rating indicates that the developer does not provide any support beyond training before 
implementation. 



Overview 



The number of schools using an approach is 
one indication of whether it can be replicated 
or implemented in more than one setting. It also 
is included so that readers can compare the to- 
tal number of schools using a particular ap- 
proach to the number that have been involved 
in research studies of that approach (see Appen- 
dix C). The number of schools studied should 
be large enough (and sufficiently representative 
of all schools using the approach) so that edu- 
cators are confident that research findings pro- 
vide an accurate picture of the approach’s 
strengths and weaknesses. 

First-Year Adoption Costs. The fifth and sixth 
rows in the table highlight the first-year costs of 
adopting the approaches. The costs are presented 
in two ways. The first — labeled first-year costs — 
is the higher of the two figures. It estimates 
schools’ costs if they must hire additional per- 
sonnel to meet developers’ staffing requirements. 
For example, some developers require schools to 
have a full-time school-based facilitator or coor- 
dinator. If current staff members cannot fill these 
roles, schools need to hire additional staff The 
second cost estimate — first-year costs with cur- 
rent staff reassigned — is the cost schools incur if 
they are able to reassign current staff members to 
meet developers’ staffing requirements. Unless 
otherwise noted, costs are estimated for a school 
with 500 students and 25 teachers and other cer- 
tified staff. 

HOW THE APPROACHES WERE 
SELECTED 

Five criteria were used to select the 24 approaches 
reviewed: 

1 . They are promoted by their developers as a 
means to improve student achievement in 
low-performing schools. 

2. They are mentioned by name in the federal 
legislation that created the Comprehensive 
School Reform Demonstration Program.^ 

3. They are used in many schools and districts. 



4. They have obtained national visibility in the 
education and popular press. 

5. There is some research evidence about their 
effects on students and/or their implementa- 
tion in schools. 

Seventeen approaches are reviewed because they 
are mentioned in the Comprehensive School Re- 
form Demonstration Program legislation. The 
other seven approaches satisfy at least three of the 
other criteria.^ 

HOW THE APPROACHES WERE 
REVIEWED AND RATED 

To prepare the table on page 4 and the profiles of 
each approach, AIR: (a) interviewed the devel- 
opers of each approach (see Appendix G for de- 
tails); (b) gathered and reviewed all available stud- 
ies about the approaches (see Appendices A and 
D); and (c) collected additional information from 
schools that are using the approaches (see Ap- 
pendix G). All profiles and tables were reviewed 
by the developers for accuracy, revised, and re- 
viewed again. In addition, developers were of- 
fered the option of submitting written comments 
(see Appendix H). 

For each approach, AIR reviewed: (1) evidence 
of positive effects on student achievement; (2) 
support that the developer provides schools as 
they implement the approaches; and (3) first-year 
costs associated with implementation. 

EVIDENCE OF POSITIVE EFFECTS ON 
STUDENT ACHIEVEMENT 

AIR made an extensive effort to gather and re- 
view all relevant material for each approach. AIR 
reviewed three types of materials (loosely called 
studies) to determine whether they were method- 
ologically sound and to assess the positive student 
achievement findings: 

• Individual studies that reported a broad 
range of achievement outcomes. For ex- 
ample, different studies reported students’ 
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performance on one or more types of mea- 
sures (e.g., standardized tests, mandated state- 
wide assessments, assessments embedded in 
a specific curriculum, and teacher-designed 
assessments). Some studies also reported 
achievement outcomes in terms of students’ 
course-taking patterns, daily attendance rates, 
graduation rates, referrals to special educa- 
tion, within-grade retention rates, or letter 
grades. 

• Studies that are available to the public. In all 
cases, the studies reviewed were available to 
school staff or others who might want to read 
them. In many cases, studies were unpublished 
but were available from the developers. 

• Changes the developers reported in test 
scores. AIR reviewed raw test score data pro- 
vided by the developers if they were accom- 
panied by contextual information that could 
be used to interpret them (e.g., number and 
grades of students tested, changes in student 
population over the testing period, and de- 
scription of implementation). Many devel- 
opers collect test data that suggest their ap- 
proach raises test scores, but few provide ad- 
equate information to relate changes in test 
scores to the approach. 

AIR reviewed more than 130 studies of student 
achievement. Each approach was rated on its num- 
ber of sound studies and the positive student 
achievement findings in those studies.^^ 

The review of the research occurred in two stages. 
First, AIR critically reviewed studies for meth- 
odological rigor, taking into consideration im- 
portant distinctions among studies such as scope 
(e.g., number of students, period over which data 
were collected), quality and objectivity of the 
measurement instruments, and affiliation of the 
researcher. Second, AIR assigned to each ap- 
proach an overall rating for positive evidence of 
effects on student achievement, based on the 
number of studies that met the criteria for meth- 
odological rigor and the effects reported in those 
studies.^^ 



In the first stage, AIR critically reviewed all stud- 
ies that reported student achievement effects for 
one of the 24 schoolwide reform approaches, 
using an instrument developed for this type of 
research review and tailored to this project, the 
Evaluation of Research on Educational Ap- 
proaches (EREA). Each study was reviewed in- 
dividually, using the EREA, by one of seven 
trained researchers. 

Each AIR researcher was assigned several reform 
approaches and reviewed all of the studies for 
these approaches. In addition, each researcher 
reviewed a sample of studies reviewed by fellow 
researchers to maintain inter-rater reliability. Two 
or more researchers reviewed one out of every 
five studies. The project director compared rat- 
ings for these overlapping studies and, in cases of 
discrepancies, retrained the researchers and clari- 
fied the issues for all project staff. 

SUPPORT DEVELOPER PROVIDES 
SCHOOLS 

To rate the level of support developers provide 
schools as they implement the approaches, AIR 
considered the following factors when review- 
ing materials developers provided and informa- 
tion gathered in telephone interviews with each 
developer: 

• Access to appropriate types of support. Most 
developers offer a variety of types of support 
(e.g., visits from the developer, newsletters, 
telephone consultation with the developer, 
and access to the developer’s Web site) to as- 
sist schools as they implement the approaches. 
Some developers provide proactive, on-site 
assistance to help schools work through is- 
sues with implementation before problems 
undermine the implementation process. 

• Frequency and duration of support. Fre- 
quency of contact and duration of support 
indicate the level of interaction schools might 
expect of the developers. Developers may 
work closely with each school, or may pro- 
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vide an approach and encourage the schools 
to work independently towards reform. 

• Tools to help schools evaluate their imple- 
mentation progress. Some developers pro- 
vide benchmarks against which schools can 
monitor their implementation of the ap- 
proach. Others help schools develop their 
own implementation plan, including sched- 
ules for expected progress. 

However, all approaches do not require the same 
amount of support from developers, and some 
are more demanding to implement than others. 
Therefore, the guide provides information on: 
(1) the critical steps developers require or encour- 
age schools to take to fully implement the ap- 
proaches; (2) the scope of actual implementa- 
tion — that is, how long the approach has been 
in schools and how many schools are implement- 
ing the approach; and (3) findings from research 
on implementation (e.g., components of the ap- 
proach that are especially easy or difficult to 
implement). This information can be found in 
the table on page 4, in the profiles of each ap- 
proach, and in Appendix E. 

ESTIMATING THE FIRST-YEAR COSTS OF 
ADOPTING THE APPROACHES 

The cost estimates in the guide are for the first 
year a school implements an approach. In most 
cases, the first year is the most expensive. AIR 
estimated the total amount schools can expect to 
pay in addition to their normal operating ex- 
penses. In some cases, this cost can be reduced if 
schools are able to reallocate current personnel 
and/or fiscal resources to support their adoption 
of a schoolwide approach. 

To arrive at cost estimates for the first year, AIR 
asked each developer to provide information on 
the costs schools generally incur. In addition, a 
random sample of schools that had adopted each 
approach were asked to share estimates of the costs 
that were actually incurred. AIR confirmed or 
adjusted the developers’ figures based on the 



schools’ cost figures and information from stud- 
ies that included cost information. 

Unless otherwise noted, costs are based on a 
school of 500 students and 25 teachers or other 
certified staff, and assume that the approach is 
implemented across the entire school. The cost 
estimates also include all components the devel- 
opers require, or strongly recommend, that 
schools adopt during their first year of implemen- 
tation. For example, if the developer requires three 
days of professional development for each teacher, 
the estimates include the cost of the training ses- 
sions and the cost of release time for 25 teachers 
for three days each. 

Costs are based on standard rates. For example, 
an average rate for a full-time facilitator or for a 
certified teacher is $50,000 per year. One day of 
release time for a teacher is based on a salary of 
$50,000/180 days, or $278 (Barnett 1996; King 
1994; Odden undated). 

Two cost estimates appear in the summary table 
on page 4 and in the profiles of each approach. 
The first, a high estimate, includes all the approach- 
related costs schools can expect to incur (i.e., train- 
ing, technical assistance, materials, and additional 
staff). Most importandy, it estimates the cost of 
any additional personnel that schools may need 
to hire to meet developers’ requirements. The sec- 
ond cost estimate, a lower dollar figure, acknowl- 
edges that some schools can reassign current staff 
members rather than hire additional staff. 

Schools could spend less than the low estimate 
if, for example, release time for training is cov- 
ered by regular district allocations, or the ap- 
proach is implemented in selected grades rather 
than all grades in the first year. Schools could 
spend more than the high estimate if, for example, 
the school opts for additional training not re- 
quired by the developer. 
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BEFORE SELECTING A 
SCHOOLWIDE REFORM APPROACH 

Local policymakers, educators, parents, and com- 
munity members make their decisions about 
schoolwide reform based on many different fac- 
tors. Such decisions can be informed by seven 
steps, outlined below. 

Step 1: Identify the school’s needs. Many schools 
engage in self-studies or audits as part of the pro- 
cess of investigating available school wide reforms. 
These procedures sharpen the schools’ under- 
standing of what is working well and what needs 
to be improved. They also generate goals that 
schools can match against the goals (and docu- 
mented effects) of various schoolwide approaches. 
Self-studies and audits also establish a starting 
point or baseline for measuring progress once an 
approach is adopted. 

Step 2: Investigate alternative approaches. In 
order to identify approaches that can meet their 
needs, schools should investigate a number of 
approaches to reform. First, approaches vary 
considerably in their philosophies, components, 
and ways of working with schools. Second, by 
casting the investigative net widely, schools in- 
crease their chances of finding an approach that 
matches their goals. More than an academic ex- 
ercise, procedures should be used to enable 
schools to pinpoint exactly what kind of effects 
on students they can expect if they implement a 
program as the developer intends (e.g., improved 
reading, math, or science achievement; better 
attendance; higher graduation rates; or fewer stu- 
dents receiving special education services). To 
make an informed selection from among the al- 
ternatives, staff members need a good under- 
standing of all the approaches under consider- 
ation. This guide is one resource for developing 
that understanding. Other resources are noted 
in a special section in the references. 

Step 3: Ask the developers questions. The 24 
approaches are changing constantly as new com- 
ponents are\added or existing components are 



revised. Schools should contact the developers for 
updates. In addition, most of the approaches are 
expanding to more and more schools as interest 
in schoolwide reform grows. Since developers may 
have too many interested schools to support ev- 
ery one, schools should contact developers early 
in the process of exploring approaches to find 
out what kind of support will be available and 
when that support can be provided. 

Step 4: Call a random sample of schools that 
are using the approaches. It is wise to ask the 
developers for a full list of schools that are us- 
ing their approaches (and schools that have dis- 
continued using the approaches), including ad- 
dresses, phone numbers, and the name of the 
appropriate person to contact. Some develop- 
ers are willing to provide such lists. 

Phone calls to a random sample of schools can 
reveal: why the schools chose the approach; how 
they addressed any implementation problems 
they have experienced; what it cost them to imple- 
ment the approach; and, most importantly, what 
kind of results they have seen, especially in terms 
of positive effects on student achievement. 
Schools already implementing the approach also 
may have evaluated the training and support the 
developer provided, and they can share this in- 
formation. By contacting as many schools as time 
permits, especially if the developers provide lim- 
ited information on the approach’s effects on stu- 
dents, the investigating school can better under- 
stand the approach. 

Step 5: Visit schools whenever possible. Steps 1 
through 4 should narrow the search for an ap- 
proach that best meets a school’s needs, which 
makes it possible to arrange school visits for the 
top few choices. Most developers recommend that 
schools take this step. School visits provide an 
opportunity to see the approach in action: to visit 
classrooms; to meet with school staff; and to talk 
to students, parents, and community members. 
They also give would-be adopters a sense of how 
an approach operates in different schools, and if 
visitors’ resources permit, in different school dis- 
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tricts and communities. While approaches that 
offer highly structured curricula and instructional 
strategies may look quite similar across settings, 
those that advance a philosophy or general ap- 
proach to school reform may operate differently 
in different settings. 

Step 6: Match the developers requirements with 
available resources. The cost information in this 
guide is a good starting point for comparing re- 
sources and requirements. It captures the out-of- 
pocket costs that developers typically charge for 
training, consultation, and materials, and it flags 
less-obvious costs that schools need to consider 
(e.g., hiring new staff, purchasing additional 
books for libraries, and asking faculty to develop 
curriculum materials). But the actual costs of 
adopting and sustaining an approach vary widely 
across schools and districts. 

For example, the costs of training and technical 
support from the developer often vary, depend- 
ing on whether expenses can be shared among 
local schools adopting the approach. Economies 
of scale apply when clusters of schools implement 
the approach at the same time. Some developers 
allow schools to tailor their implementation by 
phasing in components (and their associated 
costs) over tirne; others do not. Some approaches 
ask instructional staff to enroll in college courses 
to update their subject-matter knowledge; oth- 
ers ask them to meet before and after school, or 
to work extended hours. Such requirements have 
cost implications. 

To determine the feasibility of adopting an ap- 
proach, compare all the requirements developers 
ask schools and districts to meet with available 
resources. 

Step 7: Put the decision to a vote. Because staff 
support is critical to success, the decision to 
adopt a schoolwide reform approach should in- 
volve the entire staff and be supported by a large 
majority. Many developers recommend that the 
staff vote on adopting an approach. In fact, many 
require that 80 percent or more of the staff vote 



for adoption, by secret ballot, before they will 
agree to work with a school. 

The information in this guide is central to the 
second step, investigating alternative approaches. 
The guide will assist readers as they: examine an 
approach’s track record for improving student 
achievement; learn about the support developers 
provide schools and districts before and after 
adoption; and develop an understanding of the 
costs involved in adopting an approach. 

USING THIS GUIDE TO 
INVESTIGATIVE SCHOOLWIDE 
REFORM 

This guide includes much of the basic informa- 
tion readers need to investigate the 24 approaches 
reviewed: (a) the table on page 4; (b) the profiles 
of each approach; and (c) the more detailed in- 
formation in the appendices about studies of the 
programs’ effects on students, implementation 
requirements, and costs. 

To support readers’ further investigation, the 
guide references two additional sources of infor- 
mation: (a) the developer of each approach; and 
(b) additional readings on each approach. The 
developer’s name and address, including its Web 
site address, is listed at the end of each profile. 
Papers, articles, and books written about the ap- 
proaches are listed in the references. 

Busy readers are cautioned against relying exclu- 
sively on the table on page 4. The table provides 
limited information that is not sufficient to un- 
derstand the ratings fully. Readers need to read 
each of the profiles of the approaches to under- 
stand the ratings. 

Here are some siif^p^cstcd wavs to use th IC O-111/^g* 

' OO ' ' J o 

• Consult the table on page 4 to compare the 
ratings assigned to the approaches. 

• Read the profile of each approach to under- 
stand the ratings assigned and the costs of 
adopting the approach. In addition, the pro- 
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files provide an overview of each approach 
and describe its major components. 

• See Appendix B for ratings of the studies AIR 
reviewed. 

• Review Appendix C for details about studies 
of the approaches’ effects on students. 

• Review Appendix E for information from 
studies that document schools’ experiences 
implementing the approaches. 

• See Appendix F for details about the costs of 
adopting the approaches. 

• See the brief discussion on page 7 to find out 
how the approaches were selected for this 
guide. 

• Turn to Appendices A and D for details about 
how the approaches were reviewed and rated. 



• Consult the guide’s references to read more 
about specific approaches. 

• See the special section in the references to find 
out about other guides that describe the re- 
form approaches. 

• Follow the steps outlined in Before Selecting a 
Schoolwide Reform Approach to make an in- 
formed decision. 

CONCLUSION 

This guide is a tool to help schools investigate 
schoolwide reform approaches. Information is 
presented in varying degrees of detail, from the 
table on page 4 to the detailed descriptions of 
the research in the appendices. We hope that read- 
ers will find it useful. 



* According to the Comprehensive School Reform Demonstration Program (“Obey-Porter ’), “comprehensive” approaches integrate 
nine components: effective research-based methods and strategies; comprehensive design with aligned components; professional 
development; measurable goals and benchmarks; support within the school; parental and community involvement; external techni- 
cal support and assistance; evaluation strategies; and coordination of resources. 

^ In 1991, corporate America launched an ambitious research and development program, the New American Schools Development 
Corporation (now New American Schools), to develop several new approaches to school reform. NAS DC design teams began 
piloting these approaches in 1992. 

^ The Comprehensive School Reform Demonstration Program provides funds to states for grants to schools of at least $50,000 per 
year for three years for whole-school reform. 

^ The project sponsors mailed a Request for Qualifications to 15 nonprofit research and development organizations on May 8, 1998. 
Statements of qualifications were submitted on May 22. AIR was awarded the contract, which began on June 1. AIR is an indepen- 
dent, nonprofit research and development organization based in Washington, D.C. 

^ It is important to note that reform approaches that are operating in a large number of schools or have been operating for a long 
period of time are better situated to provide a strong research base. 

^ Due to the limited data in many subject areas, ratings are based on evidence of positive effects on student achievement across subject 
areas, rather than within specific subjects. 

^ In some cases, sources other than the developer, such as regional assistance centers or publishers, also provide support. The ratings do 
not reflect support from these sources. 

® The programs mentioned in the Comprehensive School Reform Demonstration Program legislation are: Accelerated Schools, Americas 
Choice, ATLAS Communities, Audrey Cohen College, Coalition of Essential Schools, Community for Learning, Co-NECT, Direct 
Instruction, Expeditionary Learning Outward Bound, High Schools That Work, Modern Red Schoolhouse, Paideia, Roots and 
Wings, School Development Program, Success for All, Talent Development High School with Career Academies, and Urban Learn- 
ing Centers. 

’ Preliminary analysis was also conducted on the Edison Project and Montessori. After reviewing the results, however, both developers 
presented AIR with convincing arguments that additional data needed to be reviewed to arrive at an accurate rating of student 
achievement effects. The scope of this additional data gathering and analysis could not be accommodated within project timelines. 
Thus, neither approach is included in this Guide, We hope to include both in the next edition. 

The rating criteria draw on multiple sources, including Stringfield (1998), National Center to Improve the Tools of Education 
(1998), and U.S. Department of Education (1998). The projects advisors and experts in educational evaluation reviewed draft 
versions of the criteria used to rate the evidence for each approach. The final criteria reflect their comments and suggestions. 

“ The reported analyses treat all studies equally. In fact, studies differ on a number of dimensions, including the number of schools 
studied, the number of grade levels tested, the number of outcome measures used, and the number of students included. Given the 
available data, it was not possible to take all of these sources of variation into account in the analysis. But, to examine the sensitivity 
of the results to alternative assumptions about the studies, a supplementary analysis was conducted in which studies were weighted 
based on the number of schools included. The weighting made very little difference in the overall results. 

Some schools may choose to develop their own schoolwide reform rather than use a preexisting model. This guide, however, focuses 
on externally developed approaches to schoolwide reform. 
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Accelerated Schools 



Evidence of positive effects on student achievement 




Year introduced in schools 


1986 


Number of schools 


1,000+ 


Support developer provides schools 


3 


First-year costs 




with new staff 


$27,000 


with current staff reassigned 


$14,000 



® = Strong = Promising (i = Marginal O = Mixed, Weak ?= No Research 



OVERVIEW 

The Accelerated Schools approach was developed 
in the belief that at-risk students should have the 
same rich curriculum and instruction typically 
reserved for the ''gifted and talented.” The 
approach's name signifies the developer s convic- 
tion that at-risk students must learn at an accel- 
erated pace to catch up with more advantaged 
students. Thus, the primary goal is for at-risk stu- 
dents to perform at grade level by the end of sixth 
prade. 

O ' 

Under the approach, members of the school com- 
munity are encouraged to work together to trans- 
form classrooms into environments where stu- 
dents think creatively, explore their interests, and 
achieve at high levels. Central to this approach is 
the work of John Dewey, an education philoso- 



pher who believed that an “effective education” 
in a democratic country implies faith in the po- 
tential of children and adults to understand and 
shape the world. 

The approach is grounded in three principles. 
The first is unity of purpose y which means that 
parents, teachers, students, and administrators 
strive, toward a common set of goals. The second 
is school-site decisions and responsibility, in which 
all members of the school community are encour- 
aged to share responsibility for making and imple- 
menting decisions, and for holding themselves 
accountable for the results. The third principle is 
building on strengths, which means that schools 
should draw on the expertise and experience of 
everyone involved in the school community. 
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The approach was developed by Henry Levin, 
Professor of Higher Education at the Stanford 
University School of Education. Accelerated 
Schools was first implemented in two San Fran- 
cisco Bay Area elementary schools in 1986. To- 
day, there are more than 1,000 Accelerated 
Schools in 40 states. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of Research Base. Research on the ef- 
fectiveness of Accelerated Schools is marginal. 
Five studies examined the effects of Accelerated 
Schools on student achievement. Four followed 
a single school for two years; the fifth compared 
eight Accelerated Schools with schools that had 
implemented other reform models. Two of the 
five studies were considered sufficiently rigorous 
to report the findings here: one was conducted 
by a principal and a local professor; the other was 
conducted by independent researchers. However, 
the Manpower Demonstration Research Corpo- 
ration is currently conducting a large indepen- 
dent study of Accelerated Schools that focuses 
on student achievement and other outcomes. This 
study should be released in 1999. In addition, 
the developer collects and makes available to the 
public data on test score gains for Accelerated 
Schools. 

There is a strong base of research on implemen- 
tation. Eight studies tracked the implementation 
progress of Accelerated Schools, and four studies 
in single schools (noted above) confirm some of 
the patterns observed in these studies. 

Effects on Students. Of the two rigorous studies 
that report student effects, both suggest that Ac- 
celerated Schools improves student achievement, 
at least on certain measures. In one study of a 
school where the approach was well implemented, 
student test scores in reading, writing, language, 
and mathematics improved over two years, in 
most cases surpassing the scores of students in a 
matched control school. Student achievement 
had been below grade level in reading and lan- 



guage (on the Metropolitan Achievement Test) 
before the school adopted the Accelerated Schools 
approach; after two years of using the approach, 
students in most grades were achieving above 
grade level. 

Another study compared Accelerated Schools to 
schools using Success for All and locally devel- 
oped reform programs, grouping schools to con- 
trol for socioeconomic status and controlling for 
students’ prior achievement. Among schools with 
moderate poverty (43 to 54 percent of students 
receiving free or reduced-price lunch), the Ac- 
celerated Schools outperformed the others on 
Word Attack, but did not perform as well on 
Writing. In a group of high-poverty schools (62 
to 71 percent free or reduced-price lunch). Ac- 
celerated Schools outscored Success for All on 
Writing, but did not do as well on Word Attack. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Accelerated Schools encour- 
ages broad participation in decision making by 
administrators, teachers, and parents. Collabo- 
rative inquiry guides school organization, which 
serves as a model for governance. 

Schools are required to create two faculty posi- 
tions: a part-time (25 percent) coach, and a part- 
time internal facilitator. The coach, typically 
someone affiliated with the district office, the state 
department of education, or a university, provides 
some of the training and technical assistance re- 
quired to implement the approach. The facilita- 
tor, typically a member of the school’s staff, as- 
sists the coach in this process. 

Curriculum and Instruction. The developer ex- 
pects each school to make its own decisions about 
curriculum, instructional strategies, and resource 
allocation. However, it expects the Accelerated 
Schools philosophy to guide those choices. For 
example. Accelerated Schools literature empha- 
sizes educational philosopher John Deweys be- 
lief that children learn best through collaborative 
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inquiry, which involves working with others to 
solve shared problems. Schools are expected to 
implement a curriculum that provides all students 
with opportunities to use hands-on approaches 
to solve problems while working in pairs or in 
small groups. 

In addition, the developer encourages schools to 
make curricular and pedagogical choices that em- 
phasize student strengths, language development 
across subjects, and problem-solving and higher- 
order analytic skills. The developer also expects 
decisions to be guided by common objectives for 
all students, and hopes that schools will provide 
opportunities for students to understand what they 
are learning by grounding that learning within the 
communities and cultures of the students. 

Supplies and Materials. The developer does not 
require or provide schools with particular mate- 
rials, but recommends that materials be consis- 
tent with the curricular approach described above. 

Scheduling and Grouping. Schools are encour- 
aged (but not required) to group children het- 
erogeneously, to use cross-age groups, and to use 
students as peer tutors. 

Monitoring of Student Progress and Perfor- 
mance. In addition to the kind of student learn- 
ing that standardized tests measure, the devel- 
oper recommends that schools measure student 
creativity and resourcefulness, critical-thinking 
skills, and problem-solving abilities. The devel- 
oper also suggests the use of demonstration 
projects and portfolios of student work. 

Family and Community Involvement. The de- 
veloper believes that involvement of parents is 
central to the success of Accelerated Schools. Par- 
ents are expected to read and agree to a state- 
ment that clarifies the schools goals and outlines 
the obligations of parents, students, and the 
school staff. Schools encourage parents to become 
involved with the decision-making process by 
joining task forces or committees. 



SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical As- 
sistance. During pre-service training, a core team, 
consisting of the principal, the coach, and the 
internal facilitator, receives training from either 
the developers headquarters at Stanford Univer- 
sity or one of 13 satellite centers located across 
the country. Training involves an intensive five- 
day summer workshop, two subsequent two-day 
sessions on “inquiry” (active questioning) and 
“powerful learning” (learning that arises from an 
alignment of school organization, climate, cur- 
riculum, and instruction), and ongoing mentor- 
ing by a center staff member. The coach provides 
two days of training for the entire school just 
before the school year begins. 

During the first school year, the coach provides 
six days of professional development designed to 
help the school implement the components of 
Accelerated Schools. Coaches also provide schools 
with ongoing support, by visiting each school at 
least once a week and facilitating meetings among 
school faculty. 

In the second and third years, schools continue 
to receive regular on-site assistance from the 
coach, who targets assistance toward those com- 
ponents of the Accelerated Schools model that 
the school finds most challenging. Schools may 
continue to receive assistance related to imple- 
menting the components of the programs, or add 
new topics (e.g., aligning the school curriculum 
with state and district policies) as needed. 

Schools have the option of entering into a Basic 
Partnership Agreement with the developer. Schools 
that exercise this option also receive one visit per 
year from an Accelerated Schools Project staff 
member and attend a year-end retreat to review 
progress and to plan. The Accelerated Schools 
Project also conducts national and regional con- 
ferences for staff from participating schools. A 
newsletter, published three times a year, focuses 
on implementation topics, such as the role of 
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coaching and successful experiences of Accelerated 
Schools. 

Schools may extend their agreement with the 
developer by contracting with one of 13 regional 
satellite centers for additional site visits and other 
services as needed. Information about some of 
the training and professional development activi- 
ties offered by satellite centers is available through 
the Accelerated Schools Web site. 

Implementation Requirements and Schools’ Ex- 
periences. Accelerated Schools staff recommend 
that interested schools complete a two-phase ex- 
ploration process (lasting from one to three 
months) before implementing the approach. In 
the first phase, the developer recommends that 
the entire staff read about the approach, talk to 
experienced principals and coaches, and visit 
schools that have adopted the approach. In the 
second phase, the developer recommends that 
school staff have conversations with the national 
center or one of the satellite centers. 

Schools wishing to adopt the Accelerated Schools 
approach must take a formal vote: at least 90 
percent of the full-time staff and community rep- 
resentatives must approve the decision to become 
an Accelerated School. In addition, the developer 
recommends involving students in age-appropri- 
ate discussions throughout the process. Finally, 
the developer advises schools to recruit for the 
position of coach, either from the local school 
district, the state department of education, or a 
local university. 

Transformation into an Accelerated School is a 
two-part process, beginning with “taking stock,” 
in which the school community attempts to 
achieve a shared vision for the school. The school 
then identifies priorities and analyzes problems 
through the “inquiry process,” a system to help 
identify problems, find and implement solutions, 
and assess results. The developer estimates that 
full implementation will take five years. 

Central to implementation is continual self- 
evaluation. Toward this end, the developer has 



created an assessment tool kit with five tools: (I) 
a school questionnaire; (2) a coach’s journal; (3) 
a school data portfolio; (4) guidelines for 
collecting school documents; and (5) benchmarks 
to compare each school with a “model” 
Accelerated School. 

Implementation studies indicate that adopting 
the approach is a slow process, one that can be 
frustrating for school staff. Some schools found 
it easier to implement the more concrete aspects 
of the approach, such as changing specific instruc- 
tional strategies. In addition, some studies deter- 
mined that successful adoption of the approach 
was influenced by the administration, and that 
administrative changes in the school could hinder 
implementation. 

Positive implementation findings include an in- 
creased sense of collaboration among teachers, 
more parent and community involvement, and 
the use of more innovative teaching methods in 
Accelerated Schools. Some studies suggest that 
these characteristics of Accelerated Schools make 
them especially appropriate for special education 
students. 

COSTS 

The first-year cost of implementing Accelerated 
Schools is $27,000, but schools can bring this 
cost down to $ 14,000 by reassigning current staff 
to fill key positions, such as internal facilitator. 

The developer charges $13,000 to $15,000 per 
year for a Basic Partnership Agreement, a mini- 
mum three-year commitment. The first year of 
the Basic Partnership Agreement includes: train- 
ing for the coach, principal, and internal facilita- 
tor (excluding travel); training materials and three 
copies of the Accelerated Schools Resource Guide; 
one visit by a project staff member; technical as- 
sistance by phone and e-mail; a year-end retreat; 
a subscription to the Accelerated Schools news- 
letter; and access to an electronic network of Ac- 
celerated Schools. In the second and third years, 
the Agreement.includes targeted professional de- 
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velopment, ongoing technical assistance, one visit 
by an Accelerated Schools staff member, the year- 
end retreat, and a subscription to the newsletter. 

Schools will accrue costs in addition to that of 
the Basic Partnership Agreement, including 25 
percent of the salary and benefits of the coach 
(estimated at between $12,000 and $20,000 if 
the coach is external to the school). According to 
the developer, there is no additional expense for 
faculty release time for professional development; 
the developer works with the school to fit pro- 
fessional development into existing district- 
allocated training days. 

An independent study comparing costs of school 
reform approaches estimated that the Accelerated. 
Schools approach would cost $17,000 per year 
for a school of 500 students for minimal imple- 
mentation (coach commitment of 20 percent 
time, and training time reallocated from other 
activities). The approach could cost as much as 
$80,000 for a school of 500 students if the coach 
is assigned to the school 50 percent time and the 



school pays for release time or stipends for teach- 
ers. These estimates include the coachs salary and 
benefits ($12,000 to $30,000); the coachs train- 
ing ($5,000); and school staff training ($0 to 
$45,000). According to the developer, however, 
no Accelerated School has ever incurred these hy- 
pothetical expenses. 

CONTACT INFORMATION 

Ms. Claudette Sprague 

National Center for the Accelerated 
Schools Project 

Stanford University 
CERAS 109 

Stanford, CA 94305-3084 
Phone: 650-725-1676 
Fax: 650-725-6140 
E-mail: hfcys@forsythe.stanford.edu 
Web site: 

http://www.stanford.edu/group/ASP 
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America’s Choice 



Evidence of positive effects on student achievement ^ 

Year introduced in schools Program named “Americas Choice” 



Number of schools 
Support developer provides schools 
First-year costs 
with new staff 
with current staff reassigned 

® = Strong = Promising O = Marginal 



in 1998 
300 



$190,000 

$90,000 

O = Mixed, Weak ?= No Research 



OVERVIEW 

The primary goal of Americas Choice is to raise 
academic achievement by holding students to 
high standards in the core subjects of English, 
language arts, mathematics, and science. This 
includes proficiency in reading by the third grade, 
readiness for algebra by the eighth grade, the abil- 
ity to write clearly and concisely by the tenth 
grade, and knowledge of biology, chemistry, and 
physics (for a Certificate of Initial Mastery) by 
graduation from high school. 

The Americas Choice School Design centers on 
five areas: standards and assessments, learning 
environments, community services and support, 
high-performance management, and public and 
parent engagement. 



Americas Choice is one of several approaches 
sponsored by New American Schools, a national 
initiative to develop replicable schoolwide reform 
programs. 

Americas Choice evolved over the past decade, 
growing out of work by the National Center on 
Education and the Economy (NCEE) to support 
and develop standards and assessments. Accord- 
ing to the developer, the approach is based on 
reviews of the research in many areas, including 
learning theory, standards and assessments, cur- 
riculum, and modern management. Beginning 
in 1992, together with another center, 17 states, 
and six districts, NCEE developed internation- 
ally benchmarked student performance standards 
and matching reference exams. Subsequently, 
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NCEE began to develop curricula to match per- 
formance standards and exams. 

In 1998, NCEE codified its research and experi- 
ence into the current Americas Choice design. 
Since the approach has been the product of such 
gradual evolution over the years, very few schools, 
if any, incorporate the full range of Americas 
Choice. Thus, it is difficult to determine the num- 
ber of schools that could be considered ‘Americas 
Choice” schools. According to the developers, 
however, Americas Choice serves all grade levels 
in urban, suburban, and rural districts, and there 
were an estimated 300 schools in 14 states using 
the approach as of July 1998. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. As a schoolwide 
approach, Americas Choice is relatively new, and 
rigorous research on student achievement out- 
comes is not yet available. No publicly available 
research studies use rigorous methodology to criti- 
cally evaluate outcomes of the approach. 

However, the developer has begun to collect stu- 
dent test data from several sites. These data are 
publicly available from the developer. In addi- 
tion, the Consortium for Policy Research in Edu- 
cation currently is under contract to conduct re- 
search on the effectiveness of this approach. 

Some research on implementation does exist. 
Four studies, conducted by contracted indepen- 
dent researchers, track the implementation 
progress of the Americas Choice schools spon- 
sored by the New American Schools Project, a 
national school reform effort. 

Effects on Students. At the tim.e of this report, 
there were no studies on which to base conclu- 
sions about the effectiveness of Americas Choice. 
However, the reader is encouraged to obtain and 
evaluate the existing test data and the research 
base on which Americas Choice is founded. 



CENTRAL COMPONENTS 

Organizational Change, Staffing, and Adminis- 
trative Support. The approach includes a com- 
ponent that targets the organization and manage- 
ment of school districts. It holds that the role of 
the central administration is to provide schools 
with clear goals, collect accurate data about 
progress toward those goals, share decision-making 
power with those most closely connected to the 
work being done in schools (e.g., teachers, class- 
room aides, principals, and parents), and hold 
schools and school staffs accountable and reward 
them as appropriate. 

Americas Choice also emphasizes the roles of sev- 
eral school leaders: the principal, design coach, 
literacy coordinator (K-8), school-to-career coach 
(high school), community outreach coordinator, 
a site council, and the leadership and manage- 
ment team. The developer expects the principal 
to be the instructional leader and human and fi- 
nancial resources leader, as well as to ensure that 
the staff has the tools needed to improve student 
achievement. The design coach’s role is to coor- 
dinate the implementation of America’s Choice 
at the school in conjunction with the principal. 
The literacy coordinator’s role is to work indi- 
vidually with K-8 teachers to help them use in- 
structional strategies recommended by the devel- 
opers. The role of the school-to-career coach in 
high schools is to help teachers use learning stan- 
dards in the curriculum, connect the high school 
to business and industry and postsecondary in- 
stitutions, and coordinate implementation. The 
community outreach coordinator serves as the 
school’s liaison to the community and focuses on 
helping students and families receive social sup- 
port services as needed. A site council monitors 
implementation of the approach. The leadership 
and management team, consisting of the princi- 
pal, design coach, literacy coordinator, commu- 
nity outreach coordinator, school-to-career coach, 
and other school staff, implements the approach. 

The developer requires that teachers above sec- 
ond grade specialize in two or three subjects (e.g.. 



ERIC 






29 



19 



An Educators’ Guide to Schoolwide Reform 



English and social studies, or math and science). 
The developer reasons that specializing in sub- 
jects will help teachers guide students toward a 
deeper understanding of those subjects. 

Each America’s Choice high school is divided into 
houses of fewer than 400 students. Each house 
has a separate team of teachers, a head teacher, 
and relative autonomy. 

Curriculum and Instruction. With the empha- 
sis on standards in America’s Choice schools, 
the curriculum is critical. The approach lays out 
a detailed program of instruction. According to 
the developer, the prekindergarten and kinder- 
garten curricula emphasize early literacy educa- 
tion and phonemic awareness. The curricula for 
kindergarten through eighth grade emphasize 
writing and reading, using both phonics and 
whole language approaches to reading instruc- 
tion. Additional attention is given to mathemat- 
ics, art, music, science, physical education, and 
social studies. 

The high school curriculum includes the stan- 
dard set of academic core subjects (English, math- 
ematics, science, social studies, etc.). Students take 
Americas Choice eighth-grade reference exami- 
nations in English language arts. and mathemat- 
ics to help teachers plan instruction that meets 
students’ needs. 

America’s Choice also includes a program entitled 
“on-ramps” at both the elementary and second- 
ary levels, to provide tutoring for students who 
lag behind in mathematics and reading. 

Supplies and Materials. NCEE publishes class- 
room materials that are recommended, but not 
-required. In addition, the developer provides 
workshops to help school stafffind materials that 
meet the new standards. NCEE also offers help 
to teachers interested in developing their own 
materials. Through Harcourt Brace, the. devel- 
oper offers America’s Choice schools access to 
performance standards, reference examinations, 
practice tests, and sample items and model re- 
sponses that were used on the examinations. 



Scheduling and Grouping. The developer rec- 
ommends small groups, classes, and schools. In 
the primary grades, 20 students per class is rec- 
ommended. In the secondary grades, the ap- 
proach recommends 400 students per “house.” 
Planning time must be set aside for the teacher 
team of each house, as well as for teachers of the 
same content area at each grade level, to discuss 
instructional practices. The same standards and 
materials apply to all classes. The developer does 
not suggest any specific strategy for grouping stu- 
dents within classes. 

America’s Choice also uses “class teachers.” 
Through eighth grade, these are teachers who are 
assigned to students for at least three school years. 
Thus, a student has the same teacher and class- 
mates for three consecutive years. In high schools, 
the class teacher stays with students and advises 
them until they meet the Certificate of Initial 
Mastery standard. Class teachers teach and advise 
students, and are the main contact for parents. 

For primary grades, the developer requires the 
first two and one-half hours of each day to be set 
aside for literacy. Of this block, one-half hour is 
for instruction in phonics skills, spelling, vocabu- 
lary, and grammar; one hour for writing; and 
another hour for reading. The next hour is dedi- 
cated to mathematics. Twice a week, one hour of 
art and music is scheduled. Two hours per week 
each are provided for science, social science, and 
physical education. For upper elementary grades, 
the approach designates two hours daily for read- 
ing, writing, literature, and the humanities, one 
hour for mathematics, and “substantial time 
weekly” for science, art, music, social studies, and 
physical education. For grades six through eight, 
one four-hour block per day is mandated for 
English language arts, mathematics, science, and 
social science. 

Monitoring of Student Progress and Perfor- 
mance. Since the goal of the approach is to raise 
achievement by holding students to high 
standards, teachers are required to monitor stu- 
dent progress in meeting the standards regularly. 
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using weekly oral and written assessments that 
are embedded in the curriculum. The developer 
expects students to earn a Certificate of Initial 
Mastery by their junior year, demonstrating 
proficiency against the standards for English 
language arts, mathematics, biology, physics, and 
chemistry. 

America’s Choice schools use the America’s 
Choice Reference Examinations to measure stu- 
dent growth, and the America’s Choice Portfolio 
System to make sure students’ work covers the 
full set of standards over time. The Reference 
Examinations, published by Harcourt Brace, are 
based on the America’s Choice Performance Stan- 
dards in English language arts, and mathematics 
for fourth, eighth, and tenth grades. According 
to the developer, a Reference Examination in sci- 
ence for grades four, eight, and ten is under de- 
velopment and will be available in 1999. 

Family and Community Involvement. The de- 
veloper requires schools to have a community 
outreach coordinator to support students and 
their families (e.g., helping families access social 
services). A school-to-career coordinator is re- 
quired in high schools to help develop a link be- 
tween students and employers and postsecondary 
institutions in the area. According to the devel- 
oper, both of these positions can be, and usually 
are, filled by existing personnel. 



SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. America’s Choice encourages continual 
professional development, providing workshops 
covering performance standards, examinations 
referenced to those standards, curriculum mate- 
rials, and planning. Professional development 
provided by the National Center on Education 
and the Economy generally begins with work- 
shops, followed by time for staff to practice, and 
opportunities for staff to reconvene for discus- 
sion and further training. 



O 




The developer provides intensive training for 
school leaders: 

• Literacy coordinators are expected to attend 
four one-week institutes on literacy instruc- 
tion every year for the first two years of imple- 
mentation. These institutes involve work in 
schools, where the trainers model and the lit- 
eracy coordinators try out new techniques for 
instruction. 

• There are three parts to the training for de- 
sign coaches. A first workshop is on learning 
the standards, scoring student work against 
the standards, and understanding the exams. 
A second workshop is on building a plan- 
ning process based on student assessment. A 
third workshop is bn the curriculum: choos- 
ing texts that are relevant to the standards 
and, if necessary, developing curriculum 
materials. 

• Community outreach coordinators are ex- 
pected to participate in two workshops: one 
is a full-day session with follow-up on parent 
involvement in the school; the other, pro- 
vided by the Center for Social Policy, is a part- 
day workshop on integrated social services. 

• Principals participate in a principals’ network 
with peers from other America’s Choice 
schools. 

Professional development for teachers is provided 
by these school leaders (e.g., design coach, lit- 
eracy coordinator, cluster leaders) or, for special 
situations, trainers from the developer staff. For 
example, the literacy coordinator works individu- 
ally with teachers to help them develop instruc- 
tional strategies. After participating in the insti- 
tutes on literacy, the literacy coordinator sets up 
a model classroom with one of the best teachers 
in the school. When that teacher is proficient in 
the recommended strategies, the literacy coordi- 
nator works with a second teacher. This process 
continues until the entire school is trained. 

Up to seven days of technical assistance at the 
school are offered. In addition, the National Cen- 
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ter on Education and the Economy sponsors an 
annual national conference; registration for five 
teachers each year is included in the fees paid to 
the developer. 

Implementation Requirements and Schools’ Ex- 
periences. According to the developer, before 
implementation begins, a “substantial majority” 
of the faculty must commit to the America’s 
Choice program and agree to phase it in over three 
years. 

The developer recommends a three-year plan for 
implementation. The first year should be spent 
orienting school staff to the approach and stan- 
dards; planning; preparing for and conducting 
the Reference Examinations; working on the 
school design; and conducting professional de- 
velopment. For elementary schools, the literacy 
coordinator participates in training, and for high 
schools, the school-to-career coordinator begins 
training. 

In the second year, the school continues plan- 
ning, working on the school design, participat- 
ing in professional development, and testing stu- 
dents with the Reference Examinations; the 
school also begins using the results of the Refer- 
ence Examinations and using core assignments 
in the curriculum. The literacy coordinator in 
elementary schools continues training and begins 
coaching teachers; in high schools, the school- 
to-work coordinator continues training and be- 
gins implementing that component. 

In the third year, the school continues everything 
begun in the second year and begins designing 
extended student work assignments. In elemen- 
tary schools, the literacy coordinator continues 
coaching teachers and a math institute is offered. 
The school-to-career coordinator continues train- 
ing and implementing the approach in high 
schools. 

Four studies on implementation show varied re- 
sults. After two years, America’s Choice schools 
have low levels of implementation, but have made 
some progress. Research found that America’s 



Choice schools had succeeded in setting up school 
governance committees after two years, a com- 
ponent that tends to be particularly problematic 
for other reforms. America’s Choice schools had 
also made progress in establishing standards and 
assessments, involving the community, provid- 
ing professional development, working with dis- 
trict and state administrators, and reorganizing 
the schools. In some cases, America’s Choice was 
successfully combined with other comprehensive 
reform approaches, (i.e.. Different Ways of Know- 
ing). Less progress was made on changing instruc- 
tion and curriculum, reorganizing students’ class 
assignments, and providing access to integrated 
social services. 

The research also suggests that the approach’s 
comparatively low levels of implementation are 
due to the relatively large number of schools in- 
volved in simultaneous scale-up and the complex- 
ity of the design. A serious problem was that, due 
to the size and complexity of the model, imple- 
mentation of some elements had been delayed 
by the failure to implement others. For example, 
many teachers delayed making changes to their 
curricula and instruction until they knew more 
about the standards and assessments. 

COSTS 

The first-year cost of adopting America’s Choice 
is $190,000. This covers professional develop- 
ment, including estimated staff release time; 
materials; and an estimated two staff positions. 
However, schools can lower this to $90,000 if 
they reassign current staff to fill various coach 
and coordinator positions. 

For an elementary or K-8 school of 500 students, 
the developer charges $65,000 a year for three 
years. This includes up to seven days of technical 
assistance at the school each year, copies of 
America’s Choice Performance Standards for each 
teacher, four weeks of training for a literacy coor- 
dinator, training of a design coach, workshop 
materials for faculty professional development, 
participation in periodic meetings of the princi- 
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pals’ network, and registration for five teachers at 
the annual America’s Choice National Conference. 

The developer estimates that participating el- 
ementary schools will bear the following costs: a 
design coach, literacy coordinator, and commu- 
nity outreach coordinator (expected to be cov- 
ered by Title 1 funds); travel for training of the 
literacy coordinator and design coach; tutoring; 
release time for faculty professional development; 
travel and related costs for attendance at the 
America’s Choice National Conference; admin- 
istering the Reference Exams (about $650 per 
class); release time for teacher planning integral 
to the design; and supplies for the literacy coor- 
dinator (about $1,000 per coordinator). 

Other than the developer’s fee, costs for high 
schools are anticipated to be comparable to costs 
for elementary schools. The developer charges 



$95,000 per year for high schools of up to 1,200 
students. The same number of additional staff are 
required, although high schools use a school-to- 
career coach rather than a literacy coordinator. 



CONTACT INFORMATION 
Ms. Pat Harvey 

National Center on Education and the 
Economy 

700 11th Street, NW, Suite 750 
Washington, DC 20001 
Phone: 202-783-3668 
Fax: 202-783-3672 
E-mail: info@ncee.org 

Web site: http://www.ncee.org/ac/ 
intro.html 
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ATLAS Communities 



Evidence of positive effects on student achievement 


? 


Year introduced in schools 


1992 


Number of schools 


63 


Support developer provides schools 


0 


First-year costs 




with new staff 


$98,000 


with current staff reassigned 


$90,000 


® = Strong (® = Promising © = Marginal 0 = 


Mixed, Weak ?= No Research 



OVERVIEW 

The ATLAS Communities approach (Authentic 
Teaching, Learning, and Assessment for All Stu- 
dents) is based on the belief that all students can 
and must reach their full potential. A key feature 
of ATLAS is the Pre-K to 12 “pathway.” The 
“pathway” refers to feeder patterns of elementary, 
middle, and high schools, which the approach 
seeks to coordinate to produce a coherent educa- 
tional program for each student, from the first 
day of school through graduation. 

ATLAS works with pathways toward five goals: 
(1) to improve learning for all students by focus- 
ing on teaching for understanding; (2) to evaluate 
student work through a variety of standard and 
authentic assessments; (3) to engage teachers in 
serious, sustained professional development 



through whole-faculty study groups; (4) to 
involve families and other community members 
in the education of their children; and (5) to 
reorganize the internal structures and decision- 
making processes of schools and districts to sup- 
port the above goals. 

The approach was formed in 1992 as a partner- 
ship of four school reform organizations: the 
Education Development Center in Boston, the 
Coalition of Essential Schools at Brown Univer- 
sity, Project Zero at Harvard University, and the 
School Development Program at Yale University. 
The approach is one of several sponsored by New 
American Schools, a national initiative to develop 
replicable schoolwide reform programs. 

According to the developers, ATLAS builds on a 
base of research and examined practice drawn 



ATLAS Communities 



from each of the sponsoring organizations. Spe- 
cifically, the approach draws on essential questions 
and student exhibitions from the Coalition of Es- 
sential Schools; professional development and cur- 
riculum development from the Education Devel- 
opment Center; multiple intelligences, authentic as- 
sessment, and Teaching for Understanding from 
Project Zero; and family involvement, school climate, 
and management and decision-making from the 
School Development Program. According to the 
developers, the approach is based on theories of 
change, and influenced by experiences in early sites. 

During its first several years of development, 
ATLAS worked with three pathways in Norfolk, 
Virginia, Prince Georges County, Maryland, and 
Gorham, Maine. Since then, ATLAS has 
expanded to encompass 63 schools in eight states, 
and 14 pathways. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. ATLAS is a rela- 
tively new approach, and rigorous research on its 
effects on student achievement is not yet available. 

Research on implementation is available. Five 
independent studies examined ATLAS imple- 
mentation. Four of them compared the imple- 
mentation of ATLAS to the implementation of 
other school reform approaches; the fifth exam- 
ined two ATLAS districts. As many as 22 schools 
were examined; some of the studies examined the 
same schools or pathways. 

Effects on Students. At the time of this report, no 
studies on the effects of ATLAS on student achieve- 
ment were available publicly. However New 
American Schools has commissioned a longitudi- 
nal study for which the collection of test data is 
underway. ATLAS pathways also collect and make 
publicly available test data on student effects. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. ATLAS requires professional 



staff to be organized within each school and across 
the pathway into whole-faculty study groups. 
According to developers, these study groups be- 
come the vehicle for professional development 
and a catalyst for changes in teaching, learning, 
and assessment. In addition, ATLAS schools are 
required to develop a school leadership team com- 
posed of the principal, teachers, other school staff, 
and parents (and sometimes other administra- 
tors and students). This team assumes many of 
the responsibilities traditionally held by the prin- 
cipal, such as planning the annual calendar and 
schedule, overseeing the budget, organizing pro- 
fessional development, and communicating with 
the district. The developers suggest that the rela- 
tionship between the district and school involve 
co-management. 

ATLAS provides each pathway with a site devel- 
oper, who works with school and district staff, 
organizes professional development, and helps 
implement ATLAS. Districts are required to fund 
a part-time pathway coordinator. The pathway 
coordinator typically is a teacher or administra- 
tor who is relieved of some other duties. 

Curriculum and Instruction. The ATLAS ap- 
proach to curriculum and instruction encom- 
passes the Teachingfor Understanding{i 2 xs\^^o^ 
developed by Harvard’s Project Zero. According 
to the developers, particular features of this frame- 
work include: (1) coherent learning goals and 
curricula from kindergarten through 12th grade; 
(2) focus at each grade level and subject area on a 
few important topics, emphasizing depth rather 
than breadth; (3) inclusion of basic skills taught 
in the context of solving problems; (4) develop- 
mentally appropriate curriculum and instruction; 
and, (5) respect for individual differences while 
maintaining rigor for all students. 

Instructional strategies include project-based and 
cooperative learning activities, teacher-facilitated 
discussions, and occasional direct instruction or 
lecture to provide particular kinds of information. 

According to the developers, the ATLAS ap- 
proach encourages everyone in the school to as- 
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sume non-traditional roles. Students, for example, 
are asked to become questioners, explorers, cre- 
ators, and problem solvers. Teachers and admin- 
istrators are encouraged to regard themselves as 
mentors and coaches, observing students’ work 
and providing feedback, suggestions, encourage- 
ment, and guidance for improvement. Families 
and community members are encouraged to act 
as resources for, and facilitators of, learning. 

Supplies and Materials. The developers do not 
require or provide specific instructional materi- 
als, but, as implementation progresses, they may 
recommend learning materials consistent with the 
approach. The developers require administrators 
and key teachers to use handbooks to guide fac- 
ulty study groups. These books are provided to 
30 percent of the school staff as part of profes- 
sional development (additional copies can be 
purchased for $20 each). 

ATLAS recommends that staff members purchase 
its instructional guides ($5 to $20 per book). 
Available titles include: Learning from Student 
Work, Asset Mapping, The Curriculum Planner, 
Teaching for Understanding (Harvard Project 
Zero), The Whole-Faculty Study Group (Corwin 
Press), and Dimensions of an Exhibition (Coali- 
tion of Essential Schools). 

Scheduling and Grouping. According to the de- 
velopers, because ATLAS is a framework, not a 
prescriptive program, it does not require specific 
strategies for scheduling or grouping. However, 
the developers recommend scheduling that allows 
teachers to work together in study groups. They 
also recommend flexible grouping of students and 
longer blocks of time for instruction at the sec- 
ondary level. 

Monitoring of Student Progress and Perfor- 
mance. According to the developers, ATLAS pro- 
vides a framework for student assessment, which 
should be related to standards that have been 
adopted by the state, district, pathway or school 
community. The developers recommend a range 
of assessments, including standardized tests, 
school- and teacher-made tests, exhibitions of 



mastery, portfolios, and community-based 
projects. Teachers are also encouraged to exam- 
ine and discuss student work using protocols pro- 
vided by the developers. 

Family and Community Involvement. The de- 
velopers will not implement ATLAS without sig- 
nificant family and community support. In- 
volvement is encouraged in three areas: teach- 
ing and learning; assessment; and management 
and decision making. According to the devel- 
opers, ATLAS schools engage parents and the 
community in ongoing discussions about gov- 
ernance, teaching, learning, and assessment. 
ATLAS promotes parent involvement in activi- 
ties such as parent conferences and student ex- 
hibitions, ATLAS also encourages parents and 
the community to become involved in making 
school and pathway decisions, preferably by 
joining school leadership teams. Like the staff, 
parents and community members are expected 
to review data, plan implementation, assess 
progress, and evaluate results, 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. ATLAS requires 30 percent of staff to 
participate in an annual three- to four-day lead- 
ership institute that covers topics selected by the 
school. The training is held during the summer 
or the school year at the school or a nearby profes- 
sional development center. Trainers are leaders 
of other ATLAS schools, ATLAS staff, or consul- 
tants who are knowledgeable about the institute 
topics. Principals in the pathway are encouraged 
to attend an annual three-day national principals’ 
institute; their registration fee is included in the 
approach’s adoption price. 

The developers hire staff (‘‘site developers”) with 
teaching or administrative experience to guide 
the schools through the implementation process 
by providing professional development, acting as 
mentors for teachers, and coordinating activities. 
Site developers provide workshops, follow-up 
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sessions, and support as requested by the school 
and pathway leaders. 

The cornerstone of professional development in 
ATLAS schools is the weekly study groups, in 
which all faculty participate. According to the 
developers, study groups provide a forum to dis- 
cuss instructional innovations and to solve prob- 
lems that may arise during the implementation 
of new approaches to teaching and learning. 

Other technical assistance includes: at least one 
visit by senior staff for consultation and quality 
control; an ATLAS evaluation team visit; visits 
from staff at other ATLAS communities; ATLAS 
in Practice, a quarterly newsletter that provides 
ideas and sources of materials to ATLAS mem- 
bers; and the ATLAS Web site, which allows 
school staff to engage in online discussions, . 

After three years of implementation, the devel- 
opers offer to tailor technical assistance to the 
needs of the pathway. 

Implementation Requirements and Schools’ Ex- 
periences, ATLAS requires commitment of staff 
in the pathway schools to begin implementation. 
To help schools decide whether or not to partici- 
pate, the developers offer a four- to six-month 
pre-implementation process called Charting the 
Course (developed in 1997). According to the 
developers, some pathways engage in Charting 
the Course the year prior to implementation; oth- 
ers fold Charting the Course activities into their 
first year of implementation. 

During pre-implementation, the school is en- 
couraged to examine its past performance to de- 
termine whether ATLAS can help address its cur- 
rent and future needs. An exploration team of 
approximately 1 5 people — including district ad- 
ministrators, teachers, parents, and commjanity 
leaders — is expected to attend a two-day retreat, 
followed by weekly or biweekly meetings 
throughout the pre-implementation period. The 
exploration team is expected to assemble a port- 
folio, comprising student work and surveys of 
parents, teachers, and students, to determine pri- 



orities and a strategy for reform. The team meets 
with ATLAS staff to decide whether to continue 
with the approach and plan the full implemen- 
tation process. Next, ATLAS staff meets with the 
school faculty to develop implementation goals. 
These goals should reflect district, pathway, and 
school goals. According to the developers, these 
usually include improving student performance 
on assessments and achieving higher grades. 

According to the developers, the ATLAS ap- 
proach requires substantial changes in school or- 
ganization and culture, staff attitudes and behav- 
ior, and parental and community involvement. 
The implementation process takes at least three 
years. Schools that need more time to fully imple- 
ment the approach may need to seek additional 
funding support from grants or other sources. 

Studies show that implementation differed across 
components of the approach. Some components, 
such as establishing and conducting faculty study 
groups and setting up a school leadership team, 
were implemented early in the process. Less 
straightforward changes, such as transferring 
decision-making responsibility to the school lead- 
ership team, generally occurred later or not at 
all. Some aspects, especially changes in instruc- 
tion, were well implemented at some schools and 
unevenly implemented at others. 

According to the developers, research on imple- 
mentation has been used to improve new repli- 
cations of the approach. The developers also claim 
that the various components of ATLAS eventu- 
ally coalesce. 

COSTS 

The first-year cost of adopting this approach is 
^9S,000. T*his cost cvjvcid itis^iStaiicc anci 

professional development, including teacher re- 
lease time (e.g., for weekly study groups); mate- 
rials; and the salary for a pathway coordinator. 
Schools can lower this cost to $90,000 per year if 
pathways assign a current staff member to serve 
as the part-time pathway coordinator. 
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The developer’s fee for adopting ATLAS depends 
on the number of participating schools in the 
district. If three schools join ATLAS, each pays 
$50,000 in year one, $51,700 in year two, and 
$53,330 in year three. If five schools join, each 
pays $45,000 in year one, $47,200 in year two, 
and $49,000 in year three. If eight or more 
schools join, each pays $40,000 in year one, 
$42,000 in year two, and $44,100 in year three. 
If a district establishes multiple ATLAS pathways, 
the per-school cost is lower. 

The fees cover the site developers; technical as- 
sistance visits by ATLAS staff, including one or 
more visits by senior staff; visits by practitioners 
from other ATLAS schools; registration for the 
annual principals’ institute; newsletters and train- 
ing materials; and Web site access. After the three- 
year implementation process, the cost depends 
on the level of services required. 



In addition to the above costs, districts must iden- 
tify a part-time to full-time pathway coordinator 
for each year of implementation. 

Many pathways choose to go through a prelimi- 
nary exploration of ATLAS {Charting the Course) 
before agreeing to move forward with full imple- 
mentation. There is an additional cost for these 
services. 



CONTACT 

Ms. Reggie Silberberg 
Education Development Center Inc. 

55 Chapel Street 
Newton, MA 02458 

Phone: 617-618-2401 or 800-225-4276 
x2401 

Fax: 617-969-3440 

Web site: http://www.edc.org/FSC/ATLAS 
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Audrey Cohen College: 

Purpose-Centered 

Education® 



Evidence of positive effects on student achievement 


? 


Year introduced in schools 


1970 


Number of schools 


16 


Support developer provides schools 


3 


First-year costs 




with new staff 


$161,000 


with current staff reassigned 


$86,000 


® = Strong 3 = Promising (i = Marginal O = 


Mixed, Weak ?= No Research 



OVERVIEW 

The primary goal of Audrey Cohen College: Pur- 
pose-Centered Education is to improve academic 
achievement for all students by providing an 
understandable thematic focus to education. A 
secondary goal is to increase attendance and de- 
crease disciplinary problems, as needed. The idea 
for Purpose-Centered Education grew from re- 
search on educational implications of the chang- 
ing economy. Specifically, the developer felt that 
an information-based global society requires stu- 
dents to learn and act in more complex ways. 

Purpose-Centered Education is an approach that 
seeks to transform the organization of school 
curricula. Rather than being organized around 
content areas (e.g., English, mathematics, sci- 
ence), each semester is organized around a the- 







matic “Purpose,” which incorporates the tradi- 
tional core subjects. For example, one semester 
of the kindergarten curriculum is organized 
around the purpose. We Care for Living Thing^^. 

The approach was adapted from a model devel- 
oped in 1970 under the leadership of Audrey 
Cohen, founder of the College for Human Ser- 
vices in New York City (renamed Audrey Cohen 
College in 1992). It is one of several approaches 
sponsored by New American Schools, a national 
initiative to develop replicable schoolwide reform 
programs. As of August 1998, 16 schools in six 
states use Purpose-Centered Education; 12 of the 
16 schools are elementary. The developer mar- 
kets the system to elementary, middle, and high 
schools, and maintains that the system is designed 
for all learners. 
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EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. To date, there is 
insufficient research to determine whether 
Purpose-Centered Education has positive effects 
on student achievement. No publicly available 
studies use methodology that is rigorous enough 
to evaluate student outcomes. However, the 
college annually publishes Signs ofSuccesSy which 
contains some standardized test scores in reading, 
mathematics, and language. 

Research on implementation is available, how- 
ever. Four studies, conducted by contracted and 
independent researchers, track the implementa- 
tion progress of the Audrey Cohen College 
schools that were sponsored by New American 
Schools. 

Effects on Students. At the present time, no 
studies are considered rigorous enough to sup- 
port conclusions about the effects on student 
achievement. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Purpose-Centered Education 
requires little organizational change within 
schools, according to the developer. The approach 
does, however, require that schools allow flexibil- 
ity in scheduling classes for longer or shorter time 
periods, as needed, and that teachers plan 
collaboratively. Schools are required to have a fa- 
cilitator, called a Staff Resource Specialist, who 
coordinates and sustains the reform effort. Typi- 
cally, schools staff this position with existing per- 
sonnel (c.g., a lead teacher or the director for staff 
development). 

The developer expects school principals to dem- 
onstrate strong leadership and a philosophical 
commitment to the approach, and to maintain 
open communications with the faculty. The 
Audrey Cohen College system also requires a part- 
time liaison from the central district administra- 
tion to work with the school. 



Curriculum and Instruction. The defining char- 
acteristic of Purpose-Centered Education is a re- 
designed curriculum. Students work toward two 
Purposes in each grade (i.e., one each semester), 
studying the traditional subjects such as English, 
mathematics, and science in a thematic frame- 
work. According to the developer, this organiza- 
tion is designed to focus student learning on a 
“complex and meaningful purpose” that “contrib- 
utes to the world at large.” For example, the first- 
grade Purposes .are We Work for Safetf^ and We 
Use Transportation to Bring the World Closet^^. The 
fifth-grade Purposes are We Improve the Environ- 
ment^ and We Use Technology to Meet Human 
Needt^\ the 12th-grade Purposes are I Apply My 
Special Knowledge to Make a Better WorlcP^ and 
We Invent Cultural Relationships for a Stronger 
WorlcF^. 

Each semester, students plan, implement, and 
assess a Constructive Action® in which the knowl- 
edge and skills they have learned that semester 
are used to benefit the community and the larger 
world. 

The developer does not specify a particular in- 
structional strategy, but encourages schools to 
incorporate a range of instructional practices. 
These practices may include: flexible scheduling 
of classes; whole-class, small-group, and indi- 
vidual instruction; team teaching; guest speakers 
(especially parents) who are termed ‘‘Purpose 
Experts”; “Purpose Trips”; and, other hands-on 
activities. 

Supplies and Materials. The developer reports 
that it strives to use a school’s existing textbooks 
and to work with schools to recommend supple- 
mental materials. Audrey Cohen College is cur- 
rently developing a list of recommended materi- 
als. Teachers are expected to develop curricula 
around each of the Purposes, using prototype 
materials. 

Technology, most significantly e-mail and Audrey 
Cohen College’s K-1 2 Web site chatrooms, plays 
an important role in facilitating collaboration 
among teachers, parents, and students. 
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Scheduling and Grouping. The developer does 
not require a particular approach to grouping stu- 
dents for instruction; however, it recommends 
grouping students at different achievement lev- 
els together. In addition, instructional staff are 
encouraged to schedule both the length of classes 
and the organization of activities and student 
groups within each period as appropriate for a 
given task. 

Monitoring Student Progress and Performance. 
The developer has identified a set of 24 generic 
abilities, or Purpose-Achievement Standards, that 
students are expected to reach to demonstrate that 
they have achieved a Purpose. These standards 
are assessed each semester, from kindergarten 
through high school. Audrey Cohen College 
works with schools to align the Purpose-Achieve- 
ment Standards with state and local guidelines 
for monitoring student progress and perfor- 
mance. The developer also emphasizes the im- 
portance of grades and writing samples, and 
coaches teachers to correct student performance 
problems. 

Family and Community Involvement. The de- 
veloper believes that parents play an important 
role in educating children. In addition to sup- 
porting their child’s learning at home, parents 
are encouraged to contribute their professional 
skills by volunteering as “Purpose Experts.” Ac- 
cording to the developer, parents and business 
leaders frequently visit the school to share with 
students their own expertise as it relates to a 
semesters Purpose. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. The developer provides professional de- 
velopment throughout the school year. At the 
start of the first year, Audrey Cohen College pro- 
vides a five-day orientation that introduces school 
staff to Purpose-Centered Education by discuss- 
ing how it works and explaining how it is imple- 
mented. Staff from current Audrey Cohen Col- 
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lege schools are used as trainers during the orien- 
tation. In addition to training staff in the sub- 
stance of Purpose-Centered Education, trainers 
seek to teach school faculties how to work more 
collaboratively. The developer uses existing staff 
development days during the school year to de- 
liver additional professional development. 

As noted above, schools are required to have a 
full-time Staff Resource Specialist who, along 
with other duties, coaches instructional staff. In 
addition, a liaison from the College is assigned 
to the district and participating schools. Starting 
in the 1998-1999 school year, liaisons may also 
be local or regional practitioners. 

Implementation Requirements and Schools’ Ex- 
periences. School districts interested in imple- 
menting Purpose-Centered Education follow 
their own decision-making processes to determine 
whether to implement the system. The approach 
does not require a vote or specific buy-in by school 
staff. After the decision to implement the ap- 
proach has been made, the College schedules a 
five-day orientation. 

Studies on the implementation of Purpose-Cen- 
tered Education conducted by New American 
Schools found several strengths: students were 
involved and enthusiastic; teachers worked hard 
and collaboratively to develop and implement the 
new curriculum; and administrators supported 
teachers. The studies also illustrate challenges to 
implementation. For example, some teachers were 
unwilling to implement the system or unable to 
develop the new curriculum; some teachers con- 
sidered the professional development to be in- 
sufficient; and some schools provided insufficient 
support in terms of materials, funding, and per- 
sonnel. The studies also found that the quality of 
professional development varied depending on 
the trainers. Some teachers felt that professional 
development activities were only peripherally re- 
lated to classroom activities, and that there was a 
lack of knowledgeable local personnel to assist 
schools in implementation. Finally, findings sug- 
gest that implementation may be easier at the 
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primary and elementary levels than at the sec- 
ondary level. 

COSTS 

The first-year cost of adopting this approach is 
$161,000. This cost covers professional devel- 
opment, including staff release time for orien- 
tation; materials; a licensing fee; and additional 
staff. However, schools can reduce this cost by 
approximately half, to $86,000, by reassigning 
a current staff member to serve as the Staff Re- 
source Specialist. 

Audrey Cohen College charges districts a one-time 
licensing fee of $7,000. Schools also pay the de- 
veloper for training and professional staff devel- 
opment: $36,685 in the first year, $23,345 in the 
second year, $22,425 in the third year, and $10,000 
in the fourth year. Materials cost $7,878 in the 
first year, $6,325 in the second year, $4,025 in the 
third year, and market price in subsequent years. 

Schools incur additional expenses for the five- 
day orientation (e.g., release time for teachers, 
materials) as well as the salaries for the Staff Re- 
source Specialist and the district liaison. Cost 
estimates are based on a school with 500 students 
and 30 teachers (with the exception of the one- 
time licensing fee, paid by the district.) Fees do 



not include travel, lodging, and meals for Audrey 
Cohen College personnel. 

Reduction of fees is possible for multiple schools 
within a district. For example, if two to four 
schools in a district join, total fees (material, pro- 
fessional development, and one-time fee) would 
be $40,563 per school in the first year (compared 
to $51,563), $27,270 per school in the second 
year (compared to $29,670), and $25,250 per 
school in the third year (compared to $26,450). 
Audrey Cohen College provides a further discount 
if five or more schools agree to join the system in 
year one; the year-one fee would be reduced to 
$31,510 per school under this scenario. 



CONTACT INFORMATION 

Ms. Janith Jordan, Vice President 

Audrey Cohen College 

75 Varick Street 

New York, NY 10013-1919 

Phone: 212-343-1234, ext. 3400 

Fax:. 2 12-343-8472 

E-mail: janithj@aol.com 

Web site: http://www.audrey-cohen.edu 
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Basic Schools Network 



Evidence of positive effects on student achievement 


? 


Year introduced in schools 


1992 


Number of schools 


150 


Support developer provides schools 


3 


First-year costs 




with new staff 


$12,000 


with current staff reassigned 


No change 


® = Strong = Promising (J = Marginal 0 = 


Mixed, Weak ?= No Research 



OVERVIEW 

The Basic Schools Network is organized around 
four priorities: 

• building a sense of community; 

• developing a coherent curriculum; 

• creating a climate that supports student learn- 
ing; and 

• developing students’ character. 

In line with these four priorities, Basic Schools 
defines five educational goals for students. After 
receiving a Basic Schools education, students 
should: 1) be able to communicate effectively; 
2) have acquired a core of knowledge; 3) be mo- 
tivated learners; 4) feel a sense of well-being; and 
5) live responsibly. 







The Basic Schools philosophy was developed by 
Ernest L. Boyer, the late president of the Carnegie 
Foundation for the Advancement of Teaching, 
based on research on community, curriculum, 
and school environment. The approach is sum- 
marized (including the research used to develop 
the approach) in his 1995 book The Basic School: 
A Community for Learning. American College 
Testing acted as a partner in the first funding 
cycle; the Ewing Marion Kauffman Foundation, 
James Madison University, and The National 
Association of Elementary School Principals are 
current partners. The first “basic school” was 
started in 1992, followed by a group of 12 el- 
ementary schools (the “original network”) in 
1994. As of summer 1998, over 150 schools are 
a part of the Basic Schools Network. Schools in- 
clude a diverse array of sites — public urban and 



43 



33 



An Educators’ Guide to Schoolwide Reform 



suburban, private secular and religious, a Native 
American tribal school, a charter school, and over- 
seas schools. Basic Schools plans to continue to 
expand both its network of regional support cen- 
ters and the number of schools using the ap- 
proach. The Basic Schools Network also plans to 
launch an urban initiative. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. The Basic Schools 
Network is a relatively new approach. It has not 
yet built a base of rigorous research on student 
achievement outcomes, nor are there studies that 
document the implementation efforts of schools. 
However, a report on achievement in the 12 
‘original network” schools is anticipated for re- 
lease by 1999. The developer also is collecting 
test data and making them publicly available. 

Effects on Students. At the time of this report, 
there are no studies of sufficient rigor on which 
to base conclusions about the student achieve- 
ment effects of Basic Schools. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Adminis- 
trative Support. This approach encourages 
schools to create a positive “climate for learning,” 
including small classes and flexible grouping, 
access to a large range of resources and materials, 
and support services and referrals for non- 
academic needs of students. 

The Basic Schools approach requires some flex- 
ibility in scheduling classes and in providing 
planning time for teachers. Schools are expected 
to set aside regular time at least once per week 
for teachers to plan. In addition, although not 
required, some Basic Schools have chosen non- 
traditional strategies for scheduling classes, such 
as keeping the same group of students with a 
teacher for at least two years and grouping chil- 
dren of different ages into the same class. 



According to the developer, administrative sup- 
port is necessary to develop a community among 
teachers, principals, and parents. In addition, 
since the approach may require modifying the 
curriculum, the principal must provide staff with 
the necessary time and resources to make these 
changes. 

According to the developer, no additional staff is 
needed. However, the developer strongly recom- 
mends small classes, especially from kindergar- 
ten through third grade, which might require the 
hiring of additional teachers and aides. 

Curriculum and Instruction. The Basic Schools 
Network does not provide or require a specific 
curriculum, but the developer does encourage 
schools to develop integrated, thematic teaching 
units that incorporate the content and skills re- 
quired by district and state standards. Examples 
of themes include: The Life Cycle; The Use of 
Symbols; Membership in Groups; A Sense of 
Time and Space; Response to the Aesthetic; Con- 
nections to Nature; Producing and Consuming; 
and Living with Purpose. 

According to the developer, in addition to creat- 
ing academic competency, the curriculum should 
help children develop character by emphasizing 
core virtues (e.g., honesty, respect, responsibil- 
ity) and by encouraging students to apply what 
they learn in the classroom to everyday life. The 
curriculum should focus on language and literacy. 
(In Basic Schools, mathematics and arts are de- 
scribed as “essential languages,” so “language,” 
here, is broadly defined.) 

Supplies and Materials. The approach does not 
supply or require specific instructional materi- 
als. However, schools are encouraged to focus on 
quality literature (e.g. Caldecott and Newberry 
books), use varied approaches to reading instruc- 
tion (i.e., phonics, whole word, and whole lan- 
guage), and have a plan for integrating technol- 
ogy into the curriculum. 

Scheduling and Grouping. The Basic Schools 
Network recommends small classes, a flexible 
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teaching schedule, and student groups appropri- 
ately assembled for each task. The developer does 
not require any specific strategy for arranging stu- 
dents into instructional groups, but suggests that 
teachers consider the purpose of the activity when 
arranging groups and use a variety of different 
grouping strategies. For example, the developer 
recommends: grouping students into homerooms 
to create a sense of family; placing children of dif- 
ferent ages together to help them learn to work 
cooperatively; placing students of similar achieve- 
ment levels together for concentrated, in-depth 
study; and working together with all students in 
the school to develop a sense of community. 

In addition to flexible grouping, the developer 
recommends flexible scheduling ‘so that the clock 
is adjusted to the lessons, and not the other way 
around.” 

Monitoring Student Progress and Performance. 

Basic Schools are expected to assess academic 
progress with diverse strategies. According to the 
developer, assessments should be developed along 
with the integrated curricula, not separate from 
them, except for mandated district or statewide 
standardized testing. 

Student progress can be assessed with a variety of 
methods, including: standardized tests; assess- 
ments given on computers; portfolios of student 
work; products from projects; pencil-and-paper 
tests; surveys of parents and teachers; and self- 
assessments. In a recent survey reported by the 
developer, 8 1 percent of Basic Schools teachers 
stated that they looked at anecdotal records, 85 
percent kept checklists of skills, 93 percent evalu- 
ated students’ performances on sample tasks, 7 1 
percent reviewed students’ portfolios, and 79 
percent examined results from students’ projects. 

Family and Community Involvement. The Ba- 
sic Schools Network encourages schools to form 
partnerships with parents and community mem- 
bers. Some schools have extensive parent volun- 
teer programs, and others have hired staff to work 
as “parent liaisons.” 



SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. Professional development in a Basic School 
is both designed at the school level and provided 
by the Network. In the first year, schools are ex- 
pected to form a staff study group around the 
book The Basic School: A Community for Learn- 
ing, School staff then develop a plan for profes- 
sional development that is consistent with the 
four major priorities of a Basic School (commu- 
nity building, a coherent curriculum, a climate 
that supports student learning, and character 
development). 

When the Network was founded, it provided 
participating schools with a yearly grant to sup- 
port teacher release time for inservice training and 
development. Schools since have created new 
daily schedules to provide such planning time for 
staffs. Professional development provided 
through the developer also includes the follow- 
ing activities: 

• Summer Institutes, These are offered in sev- 
eral locations each summer for teaching teams 
and administrators from Basic Schools. At- 
tendance is strongly encouraged and, accord- 
ing to the developer, institutes quickly fill to 
capacity. Institutes offer speakers and work- 
shops on the approach’s four priorities: com- 
munity, curriculum, environment, and char- 
acter. An institute may highlight one prior- 
ity and offer additional workshops in that 
area. Institutes also offer Network members 
time to plan collaboratively and to share suc- 
cessful teaching materials and strategies. Most 
institutes are two to four days in length. 

• Meetings for Administrators, Each year, the Ba- 
sic Schools Network holds an annual Admin- 
istrators’ Meeting, in which Network admin- 
istrators discuss challenges and successes. 

• A University Partnership, According to the de- 
veloper, most Basic Schools develop a part- 

. nership with the education department of a 
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local university. This partnership allows for 
inservice training and access to research and 
guidance for the school, while providing uni- 
versity personnel with opportunities to teach 
at the elementary level, engage in research, 
and place practicum and student teachers. 

• Mentors. A Basic Schools Network mentor 
works with staff at each school to develop 
long-term and short-term goals, create the- 
matic units, resolve problems, demonstrate 
teaching strategies, and otherwise guide staff 
through implementing the Basic Schools ap- 
proach. Most mentors are experienced staff 
members from existing schools (at this point, 
most mentors are from one of the original 
demonstration sites). Many Network schools 
have mentors who teach at the school and 
are resources for other staff. Generally, a men- 
tor will make four two-day visits per year to 
a school and be in frequent contact by e-mail, 
regular mail, phone, or fax. 

• Regional Centers. Six regional centers, located 
in Virginia, Texas, Missouri, Iowa, North 
Carolina, and Oregon, offer technical assis- 
tance, professional development, and other 
types of support (e.g., connecting schools 
with other Basic Schools in their area). Pro- 
fessional development offered through re- 
gional centers includes: building a schools 
community; developing curricula; establish- 
ing a school climate that supports learning; 
integrating character development into the 
existing curricula; addressing parent and com- 
munity groups; building business and com- 
munity partnerships; developing projects that 
serve the community; and connecting stu- 
dents with senior citizens. 

The Network also is developing distance learn- 
ing courses, workshops, and seminars to be pro- 
vided through universities. 

Implementation Requirements and Schools' Ex- 
periences. According to the developer, there are 
five stages to becoming a Basic School. First, 
schools interested in the approach contact re- 






gional centers to request information, obtain an 
overview of the approach, and arrange for a Ba- 
sic Schools mentor to visit the school. 

Second, schools that are still interested may read 
The Basic School: A Community for Learning in 
study groups, arrange for professional develop- 
ment sessions, and begin a school self-evaluation 
focusing on community, curriculum, environ- 
ment, and patterns of behavior. 

Third, schools may make a formal commitment 
with the Basic Schools Network for long-term in- 
volvement. These schools develop short- and long- 
term goals based on the school's self-assessment. 

After making a formal commitment, schools be- 
gin to set priorities. Schools at this stage are ex- 
pected to arrange for professional development 
and technical assistance from a regional center, 
participate in institutes, build leadership capac- 
ity, provide support for staff, re-evaluate the self- 
assessment, and document renewal efforts. 

Finally, a school may take a leadership role in the 
Basic Schools Network. A school at this final stage 
of implementation is committed to the central 
ideas of Basic Schools. While continuing to 
implement the approach in the school, this school 
can collaborate with a regional center and serve 
as a demonstration site for interested schools. 

COSTS 

The program director estimates the first-year cost 
of becoming a Basic School at around $12,000 
per year for a typical school, depending on level 
of implementation. This figure is stable in subse- 
quent years. .Although the developer does not 
provide or require the purchase of materials, 
implementation may require additional profes- 
sional development, release time for teachers for 
planning, and additional time for teachers for 
curriculum development. The amount of profes- 
sional development and release time will vary from 
school to school. In some cases, grants have been 
obtained to help with the cost of both implemen- 
tation and continuing support of the program. 
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Costs for implementing Basic School concepts 
also depend on whether a local mentor is avail- 
able. If not, airfare and normal travel expenses 
are incurred in addition to the mentors consul- 
tation fee, which currently is $500 per day. 

In calculating costs, schools should note the fol- 
lowing specific cost items: monthly time for col- 
laborative teacher planning; institute attendance 
for a school team of four to 15 staff persons; Ba- 
sic Schools materials for the staff (copies of the 
report, overheads, suggested curriculum enhance- 
ment materials, and additional literature); a site 
visit for a school team to an existing Basic School; 
membership fee; and consulting costs for four 
school visits. 



CONTACT INFORMATION 

Dr. Mary Ellen Bafumo, Director 

The Basic Schools Network 

lOlRoop Hall, MSC1904 

Harrisonburg, VA 22807 

Phone: 540-568-7098 

Fax: 540-568-3803 

E-mail: bafumome@jmu.edu 

Web site: http://www.jmu.edu/basicschool 
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Coalition of Essential 
Schools 



Evidence of positive effects on student achievement 


o 


Year introduced in schools 


1984 


Number of schools 


1,000 


Support developer provides schools 


Q 


First-year costs 




with new staff 


Not available 


with current staff reassigned 


Not available 


® = Strong O = Promising (5 = Marginal O = 


Mixed, Weak ?= No Research 



OVERVIEW 

The key feature of the Coalition of Essential 

Schools (CES) is the set of “Common Principles” 

that guide school reform: 

1 . The school should focus on helping children 
learn to use their minds well. 

2. The schools goals should be simple: that each 
student master a limited number of essential 
skills and areas of knowledge. 

3. The schools goals should apply to all students. 

4. Teaching and learning should be personal- 
ized to the maximum feasible extent. 

5. The governing practical metaphor of the 
school should be student-as-worker, teacher- 
as-coach. 



6. The diploma should be awarded upon dem- 
onstration of mastery of the central skills and 
knowledge of the schools program. 

7. The tone of the school should stress un- 
anxious expectation, trust, and decency. 

8. The principal and teachers should perceive 
themselves as generalists first and specialists 
second. 

9. Teacher loads should be 80 or fewer pu- 
pils, and per-pupil cost should not exceed 
traditional school costs by more than 10 
percent. 

10. The school should demonstrate non- 
discriminatory and inclusive policies, 
practices, and pedagogies. 
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The Coalition of Essential Schools (CES) is not 
a specific model of school reform. Rather, the 
Common Principles are intended to be used by 
schools to shape their own reform efforts — 
including curriculum and instruction — that fit 
their particular situations. Although the developer 
recommends several instructional techniques and 
methods of scheduling students consistent with 
the Common Principles, no specific changes are 
mandated. 

The Coalition of Essential Schools was founded 
in 1984 by Theodore Sizer, Professor of Educa- 
tion at Brown University. Based on the findings 
of Sizers A Study of High Schools, conducted from 
1979 to 1984, and his widely read book, Horaces 
Compromise, Sizer delineated a set of principles 
to guide reform in high schools. Subsequently, 
CES has expanded to include elementary and 
middle schools. In 1988, CES and the Educa- 
tion Commission of the States formed a partner- 
ship, Re: Learning, which focuses simultaneously 
on reform at the school level and policy changes 
at the state level. In 1998, approximately 1,000 
schools (more than half elementary schools) were 
engaged with CES at some level of involvement; 
about 250 of those schools were Coalition mem- 
bers. Fifty regional centers and networks provide 
support to member schools and to other schools 
exploring or planning membership. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. The research on 
Coalition of Essential Schools is extensive with 
respect to implementation, but quite weak with 
respect to student achievement outcomes. Of the 
30 available studies, six focused on student-level 
outcomes. Of these six studies, two were found 
to be sufficiently methodologically sound to re- 
port here. 

Research on implementation of the Coalitions 
Common Principles is quite strong. Twenty-four 
available studies — primarily case studies, many 
with cross-site analysis — focused on schools at- 



tempting to adopt the Common Principles, or 
some subset of them. In addition, a series of pro- 
files of 27 Coalition schools provides anecdotal 
evidence of successful implementation. 

Effects on Students. The research shows mixed 
effects on student achievement. Only two stud- 
ies were found that had student outcome data 
and were rigorous enough to be considered here. 
One study found that one school’s scores on the 
Delaware Educational Assessment Program rose 
from 46.0 to 50.5 over three years. The second 
study found that reading and mathematics scores 
on the Comprehensive Test of Basic Skills 
dropped over time. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. District commitment, as evi- 
denced by a letter from the school board or the 
district office, is a requirement for a school’s mem- 
bership in the Coalition. In addition, the school’s 
principal must be willing to include teachers and 
other staff in deciding on the school’s goals, sched- 
ules, and management. The developer requires 
that 80 percent of a school’s faculty vote to par- 
ticipate in the Coalition of Essential Schools. 

The Coalition encourages schools to think about 
ways in which they can become “smaller, more 
personalized” learning communities. To this end, 
some member schools have limited student en- 
rollment, while others have employed a “school- 
within-a-school” strategy. Although the Coalition 
does not actively promote this approach, the de- 
veloper says that implementing the Common 
Principles in a school-within-a-school can be an 
appropriate first step toward full implementation. 
If this approach is taken, the developer stresses 
the importance of the rest of the school support- 
ing the strategy and developing a plan for even- 
tual schoolwide implementation of the strategy. 

The Coalition feels that the Common Principles 
should guide change within the school’s particu- 
lar context. Therefore, the Coalition is willing to 
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work with schools regardless of their organiza- 
tional or management structure. 

Curriculum and Instruction. The Coalition does 
not provide or require schools to adopt a specific 
curriculum or particular instructional techniques. 
Instead, the developer encourages teachers to 
work with the same set of students and have com- 
mon planning time so that they get to know stu- 
dents well and can plan instruction that is intel- 
lectually focused, rigorous, and appropriate. 

As embodied in the second Common Principle, 
the Coalition suggests that teaching staff, with 
input from parents and community members, 
identify a limited number of goals students should 
achieve by the time they leave the school. Teach- 
ers should focus the curriculum and instructional 
techniques around the identified skills and knowl- 
edge, governed by the philosophy “less is more.” 
According to the developer, superficial coverage 
of many areas should give way to deep explora- 
tion of fewer areas. 

Supplies and Materials. The developer does nor 
provide or require any specific materials, bur makes 
professional development available to help teach- 
ers develop curricula around essential questions. 

Scheduling and Grouping. The Coalition encour- 
ages secondary schools to maintain a ratio of 80 
students to one teacher, and elementary schools 
to maintain a ratio of 25 students to one teacher. 
It also encourages teachers to have the same ex- 
pectations for all students and, therefore, to place 
students of different abilities together in the same 
instructional group (i.e., heterogeneous group- 
ing). The developer encourages block scheduling, 
in which classes meet for longer periods every 
other day. Both block scheduling and ream reach- 
ing (i.e., two teachers working together in several 
subject areas with a larger group of students) are 
seen by the developer as promoting deeper learn- 
ing among students. However, none of these com- 
ponents is mandatory to the approach. 

Monitoring of Student Progress and Perfor- 
mance. A key component of the Coalition of 



Essential Schools is embedded in the sixth Com- 
mon Principle, which calls for students to dem- 
onstrate their mastery of skills and knowledge. 
According to the developer, mastery is often dem- 
onstrated through student exhibitions, which vary 
across schools. For example, at some schools, stu- 
dents work during their final year of school on a 
year-long project to show their mastery of the 
subjects studied, and they take oral examinations 
in all subjects. 

The national Coalition office encourages schools 
to use a combination of standardized and “au- 
thentic” (i.e., similar to tasks one encounters 
outside of school) methods of assessment, accord- 
ing to their individual needs. In considering the 
success of their programs, CES encourages 
schools to consider developing “habits of mind” 
in students and a school culture that promotes 
decency and trust. 

Family and Community Involvement. The de- 
veloper stares that family and community out- 
reach is an important component of the approach, 
particularly in defining the goals the school sets 
for students. It encourages schools to involve fam- 
ily and community members in identifying the 
skills and knowledge that students should be ex- 
pected to master in order to graduate. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical 
Assistance. Although no specific professional 
development is mandated for teachers in 
Coalition Schools, as a condition of membership 
in the Coalition, schools must affiliate with a 
Regional Center and demonstrate that they have 
sufficient funds in their budgets for staff 
development and planning. Schools at any stage 
of the Coalition’s implementation process — 
exploration, planning, or membership (see 
Implementation, below) — may turn to a Regional 
Center for technical assistance. The developer 
provides Coalition members with optional 
professional development at the school, annual 
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publications, and access to a network of Coalition 
teachers. The annual optional Fall Forum pro- 
vides an opportunity for teachers from different 
schools and different parts of the country to come 
together to share experiences, exchange ideas 
about how the Common Principles can be imple- 
mented, and investigate instruction and assess- 
ment techniques. The Coalition is developing 
measures of school progress to help teachers and 
schools evaluate implementation of the Common 
Principles. 

Implementation Requirements and Schools’ Ex- 
periences, Implementation of the approach is 
supposed to progress through three phases: ex- 
ploration, planning, and membership. Accord- 
ing to the developer, schools that are exploring 
the Coalition of Essential Schools begin by ex- 
amining the Common Principles, discussing their 
meaning in faculty meetings, and determining 
whether the philosophy is consistent with the 
schools goals. In the planning stage, which typi- 
cally lasts at least a year, a school plans how it 
will implement the Common Principles, includ- 
ing any changes in scheduling and instructional 
practice that teachers decide will have to be made 
in order to support adoption of the Principles. 

During the planning process, a school may ap- 
ply to its Regional Center for membership. Dif- 
ferent Regional Centers have different require- 
ments for membership. However, in general, 
schools are evaluated on several criteria, includ- 
ing: agreement with the Common Principles on 
the part of the school faculty; commitment to 
reform; professional and financial support from 
the district; sufficient funds for staff development 
and planning; and a commitment to self-evalua- 
tion. In addition, schools must be willing to share 
information about their work with the Coalition 
and with other schools in the Coalition. At all 
stages of implementation, including preparing 
applications for membership, schools may turn 
to their Regional Center for technical asristance. 

Findings from the implementation research are 
mixed. Although the research suggests that suc- 



cessful adoption of the Common Principles is typi- 
cally viewed positively by teachers, it also suggests 
that adoption of the Principles is often difficult. 
Difficulties include: (1) problems in interpreting 
and understanding the Common Principles; and 
(2) problems in implementing the Principles us- 
ing a ''school-within-a-school” model. In addition, 
some implementation research has found that 
schools already perceived as successful may have a 
hard time making the changes needed to imple- 
ment the Common Principles. 

• Interpreting the Common Principles, Multiple 
researchers have reported that schools often 
have had a difficult time in determining the 
meaning of the Common Principles. This 
problem has been especially apparent in 
schools that have become members of the 
Coalition before teachers have developed a 
common understanding of the Principles and 
their application. In many cases, when teach- 
ers have then attempted to implement the 
Principles, they have realized that they did 
not all interpret the Principles in the same 
(or even similar) ways. 

• Implementing the Common Principles in a 
SchooIWithin-a-SchooL Many schools have 
attempted to implement the Common Prin- 
ciples in just one portion of the school. (Ex- 
amples of Essential Schools programs that 
have followed a “school-within-a-school” 
model have included programs for a portion 
of students at one grade level, and a “mag- 
net” program viewed as an alternative to an 
honors or a vocational track.) Typically, 
though not always, these schools have started 
the school-within-a-school program as an 
experiment, intending to implement the 
Common Principles schoolwide if they work 
well in the school-within-a-school. 

Case studies of such arrangements have 
found, at best, that Essential Schools school- 
within-a-school programs are marginalized: 
they are not seen by teachers outside the 
school-within-a-school as central to the 
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school. At worst, the school-within-a-school 
model has resulted in tension between 
teachers, with teachers outside the Essential 
Schools program feeling resentful of what 
they perceive as preferential treatment of 
teachers in the Essential school. Because of 
these tensions, this has not proven to be an 
effective means of introducing and adopting 
the Common Principles as a schoolwide 
reform. 

COSTS 

No information on costs is available from the 
developer. However, the ninth Common Prin- 
ciple states that the approach should require a 
level of funding no more than 10 percent higher 
than what the school would normally require. 



One implementation study — a set of several case 
studies — found that some schools spent far in 
excess of the recommended additional 10 per- 
cent (through a combination of extra support 
from the district and grants) to implement their 
Essential Schools programs. 

CONTACT INFORMATION 

Dr. Amy Gerstein, Executive Director 
Coalition of Essential Schools 
1814 Franklin Street, Suite 700 
Oakland, CA 94612 
Phone: 510-433-1451 
Fax: 510-433-1455 

Web site: http://www.essentialschools.org 
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Evidence of positive effects on student achievement 
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Year introduced in schools 


1990 


Number of schools 


92 


Support developer provides schools 


• 


First-year costs 




with new staff 


$157,000 


with current staff reassigned 


$82,000 
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OVERVIEW 

The goals of Community for Learning are to 
improve students’ academic achievement, behav- 
iors, and attitudes and to promote independent 
learning habits. Community for Learning en- 
courages the coordination of classroom instruc- 
tion with community services (e.g., health, li- 
braries, social services, and law enforcement) in 
an effort to improve individual student learn- 
ing. The approach is based on research on the 
influence of school, family, and community on 
student learning. According to the developer, 
schools should remain the primary focus of ef- 
forts to improve the academic achievement of 
students; however, learning is affected by a va- 
riety of environments in addition to schools 
(e.g., the workplace, church, home, community 



organizations, social service agencies, and higher 
education institutions). 

Margaret C. Wang, Professor of Educational Psy- 
chology and Director of the Temple University 
Center for Research in Human Development and 
Education, established Community for Learning 
in 1990. The roots of the approach extend back 
to the 1960s, however. During the 1970s, the 
program expanded to provide special education 
services in an “inclusion” environment and to in- 
clude all elementary and middle grades. This ver- 
sion of the program became the instructional 
model known as the Adaptive Learning Environ- 
ments Model (ALEM). A community involve- 
ment component was added in 1990, and the 
program was renamed the Learning City Program 
(LCP). In 1995, the program was renamed Corn- 
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munity for Learning. To date, 92 urban and ru- 
ral schools have implemented the Community 
for Learning approach, including 25 middle 
schools and two high schools. An additional 37 
schools are implementing selected components 
of the approach. Although a variety of students 
are served, the program is primarily geared to- 
wards “students placed at risk.” 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. There are a sub- 
stantial number of studies on the student achieve- 
ment effects of this approach. Of the 1 3 studies 
reviewed, five were sufficiently rigorous to be dis- 
cussed here. Two of these studies, including one 
that was the culmination of longitudinal research, 
were conducted by independent researchers. 

Unfortunately, few studies included data on com- 
parison groups. Although many studies looked 
at the learning progress of Community for Learn- 
ing students, they did not compare this progress 
with that of similar students receiving either no 
reform or a different model. 

In addition to research on outcomes, 1 1 studies 
have investigated the implementation of Com- 
munity for Learning, and, in particular, ALEM, 
the approach’s instructional component. 

Effects on Students. Evidence of positive effects 
on student achievement is promising, based on 
the outcomes from five studies. One study, by 
the developer of Community for Learning, found 
that students using the approach had higher read- 
ing and mathematics achievement than students 
who were not using the approach; and that test 
scores in schools using the approach improved at 
the same time that scores in similar schools de- 
clined. A second study, also by the developer, 
found that mathematics and reading standard- 
ized test gains were significantly higher for stu- 
dents in Community for Learning schools com- 
pared to national norms. This study also found 
that mainstreamed special education students in 



Community for Learning schools scored signifi- 
cantly higher than similar students not using the 
approach. 

The only two rigorous studies conducted by in- 
dependent researchers did not find such positive 
results, however. One study found no differences 
in student achievement with respect to the 
amount of time spent in Community for Learn- 
ing classes, and found no significant differences 
in achievement across three years of implemen- 
tation. These findings may be due to the students’ 
high level of initial achievement. The other study 
investigated differences in students’ rates of 
progress; it found that Title 1 students and spe- 
cial education students in a Community for 
Learning school progressed at a significantly 
slower pace than regular education students. Be- 
cause both of these studies compared different 
groups of students within Community for Learn- 
ing schools, they do not show whether the ap- 
proach as a whole is more or less effective than 
other approaches. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Community for Learning en- 
courages a system of shared decision making in- 
volving school staff, parents, and the community. 

To implement the approach, a small number of 
additional staff may be required. The developer 
requires each participating school to have a fa- 
cilitator. Each district is required to have a staff 
member work part-time to coordinate among 
Community for Learning schools in the district 
and with community social service agencies. The 
developer assumes that these positions can be 
filled by reassigning existing staff to new roles. 

There are also several site-based teams that must 
be created. These include a School Council Lead- 
ership Team and an instructional team. 

Curriculum and Instruction. Community for 
Learning uses the Adaptive Learning Environ- 
ments Model (ALEM) for instruction. This 
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model is based on the premise that the key to 
high achievement is to tailor instruction to the 
particular needs of individual students, focusing 
first on literacy. In line with this philosophy, the 
approach requires an individualized learning plan 
for every student. 

The ALEM model encourages teachers to use a 
range of grouping strategies, depending on the 
task, such as working with students individually 
and in small- and whole-group instruction. 
Teachers are expected to teach both individually 
and as a team. 

Although a range of teaching strategies are pre- 
scribed, Community for Learning does not pro- 
vide or promote specific curricula or frameworks. 
Instead, the developer attempts to align school 
curricula and instruction with district or state 
standards. 

Supplies and Materials. Community for Learn- 
ing does not provide or require special supplies 
or materials. Instead, teachers are expected to cre- 
ate and maintain materials in line with the ALEM 
philosophy. According to the developer, materi- 
als should be “student-centered” and suitable for 
“interactive teaching.” 

Scheduling and Grouping. Teachers in Com- 
munity for Learning schools are expected to 
group students in whole classes, in small groups, 
and individually, depending on the task and stu- 
dent needs. The developer notes that teachers 
work in teams and have collective responsibility 
for students, so students may work with other 
classes or grades as appropriate. The developer 
encourages the daily schedule of class periods to 
be adjusted as needed for the given task. 

No specific scheduling changes are required. 
However, the developer recommends providing 
a common planning period for teachers. 

Monitoring Student Progress and Performance. 
The instructional model, ALEM, advocates the 
development of an individualized learning plan 
for each student; students progress at their own 
pace and teachers provide regular feedback to stu- 



dents. Instructional staff are expected to keep 
daily records of performance (e.g., completing 
tasks). Criterion-referenced assessments (where 
students’ knowledge and skills are measured) are 
used to assess each student’s skill level. If students 
are performing significantly below or above ex- 
pectations based on criterion-referenced assess- 
ments or ongoing records of performance, the 
plan for instruction is modified. Modifications 
may include altering the pace of instruction or 
adapting the materials students use in class. 

Family and Community Involvement. Commu- 
nity for Learning supports the idea that students 
learn outside as well as inside the classroom. Suc- 
cessful reform, according to the developer, must 
coordinate education, health care, law enforce- 
ment, and other social services to support stu- 
dent learning. 

The approach emphasizes open communication 
and a sense of shared responsibility among the 
school, parents, and community. In line with this 
philosophy, schools are encouraged to conduct a 
variety of activities to inform parents of the ap- 
proach as it is implemented. Although the spe- 
cific types of parent or community involvement 
activities are determined at the school level, 
schools are required to give formal and informal 
reports on student progress to parents and are 
expected to encourage parents to participate in 
modifying individualized instructional plans and 
be involved in the child’s education at home. 

The developer encourages Community for Learn- 
ing schools to make community services more 
accessible. For example, schools might establish 
a health center or coordinate with hospital mo- 
bile services to make periodic visits. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical As- 
sistance. Professional development activities be- 
gin before the approaches implemented and con- 
tinue during the school year. In pre-implemen- 
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ration, Community for Learning staff spend two 
or more days discussing the approach with school 
staif and community members, and school staflF 
spend another.one to two days assessing the needs 
of their particular school. Following this prelimi- 
nary training, the developer spends four days each 
with principals, facilitators, school staff, and dis- 
trict staff providing more detailed instruction in 
the approach. Ongoing staff development dur- 
ing the school year consists of eight to ten days 
of on-site professional development and techni- 
cal assistance for school staff, additional training 
for the facilitator, and program evaluation assis- 
tance for district staff According to the devel- 
oper, professional development is tailored to the 
needs of the school and instructional staff based 
on information gathered through regular assess- 
ment of implementation. Topics may include 
standards, instructional strategies, training for the 
instructional team, mentor training, and facili- 
tator training. 

The facilitators are trained by the developer on 
site and at three to four regional one-day meet- 
ings each year. In addition, all facilitators from 
Community for Learning schools in a district 
meet monthly to share strategies. 

Implementation Requirements and Schools’ Ex- 
periences. The developer has identified nine steps 
required to implement Community for Learn- 
ing (recognizing that some steps may vary some- 
what depending on the site). The steps are ex- 
pected to take three years and are grouped into 
three phases: 

• providing information to the district or 
school and helping establish a team for 
implementation; 

• assessing district- and school-level needs and 
planning; and 

• putting the plans into action. 

During the first phase, providing information to 
the school district: 1) the district or school con- 
tacts the Center for Research in Human Devel- 



opment and Education (CRHDE) to learn more 
about the program; 2) district or school repre- 
sentatives meet with a Community for Learning 
representative to discuss the program and how it 
can be implemented; and 3) a district leadership 
team is established to work with CRHDE to de- 
velop an implementation plan outlining the sup- 
port that will be provided to all participating 
schools. At this point, the district’s central office 
assigns a project director as a liaison between the 
Community for Learning schools in the district 
and CRHDE. 

The second phase, assessing and planning dis- 
trict- and school-level needs, involves: (1) ensur- 
ing that there is staff consensus and commitment 
for implementing Community for Learning; (2) 
assessing the district’s and school’s needs and 
strengths, through discussions with the district 
leadership team, parents, school staff, adminis- 
trators, and community leaders and through 20/ 
20 analysis of student achievement (looking at 
the top and bottom 20 percent of students); and 
(3) working with Community for Learning 
implementation specialists to develop a specific 
plan for each school. 

The third phase, putting the plans into action, 
includes: (1) pre-implementation training of 
school StaflF, administrators, and a full-time, on- 
site facilitator assigned to each school; (2) moni- 
toring progress toward the objectives set out in 
the plans (e.g., through meetings among key 
stakeholders, interviews of staflF and students, and 
degree of implementation assessments); and (3) 
measuring student achievement against district 
or state standards on an ongoing basis. 

The developer states that it guides implementa- 
tion closely. At least every quarter, the developer 
reviews achievement data and shares findings with 
instructional staff. Twice a year, the developer 
visits the school to evaluate implementation, us- 
ing indicators of implementation. Further, facili- 
tators are trained to use these indicators to target 
professional development to teachers’ needs. Al- 
though teachers may join throughout the year. 
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by the end of the first year of implementation, 
the developer expects all teachers to be working 
with the approach. 

An interim implementation report by the deveL 
oper found, among other things, that: pre-imple- 
mentation was feasible; the pre-implementation 
training provided school staff with sufficient 
knowledge and skills to implement the program; 
classroom instructional practices did change as a 
result of the program; and student achievement 
improved. The report did not discuss the diffi- 
culties, if any, faced by schools implementing 
Community for Learning. 

A number of studies by the developer also have 
investigated implementation using a specific as- 
sessment tool. For example, a series of articles 
investigating implementation of Community for 
Learning in ten districts found that, by the end 
of the first year, the average degree of implemen- 
tation was high, with average scores across 12 
dimensions and across sites of 92 percent. All 
dimensions were implemented at or above 83 
percent. In addition, there was a continuous pro- 
gression of implementation seen across three site 
visits during the year. These studies also con- 
cluded that Community for Learning tended to 
be related to students’ positive perceptions of their 
school and learning. Students using the approach 
tended to feel that the instructional environment 
(including teachers’ attitudes and approaches to 
instruction) was more supportive and tended to 
have better self-concepts compared to students 
in classes not using the approach. 

COSTS 

The first-year cost of adopting Community for 
Learning is $157,000. This cost covers profes- 
sional development, including staff release time, 
and additional staff. This cost can be reduced to 



$82,000 by reassigning a current school staff 
member to serve as the school facilitator and a 
current district staff member to serve as the part- 
time project coordinator. 

According to the developer, the costs of imple- 
menting Community for Learning in a school of 
500 students vary from school to school depend- 
ing on the amount of guidance the school needs. 
The first-year costs of pre-implementation train- 
ing and technical assistance from the developer 
are estimated to be $30,000 per school; the sec- 
ond-year costs to be $15,000 per school; and the 
third-year costs to be $5,000 per school. A more 
detailed breakdown of the fees paid to the devel- 
oper is not available. The developer does not ac- 
count for the costs associated with reassigning 
existing personnel to the roles of school facilita- 
tor and district coordinator. Each school requires 
a full-time school facilitator, and each district, a 
part-time coordinator. If additional personnel are 
hired, these costs must be added. In addition, a 
school or district may encounter “hidden costs,” 
such as release time for staff, which are not in- 
cluded in the above estimates. 



CONTACT INFORMATION 

Ms. Cynthia Smith, Director, Information 
Services 

Temple University Center for Research in 
Human Development and Education 

1301 Cecil B. Moore Avenue 
Philadelphia, PA 19122-6091 
Phone: 800-892-5550 
Fax: 215-204-5130 
E-mail: lss@vm.temple.edu 

Web site: http://www.temple.edu/LSS/ 
cfl.htm 
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Evidence of positive effects on student achievement 
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Support developer provides schools 
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First-year costs 
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with current staff reassigned 
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OVERVIEW 

Co-NECT is a schoolwide approach that focuses 
on improving achievement by integrating tech- 
nology into instruction, organizing lessons 
around interdisciplinary projects, and reorganiz- 
ing schools into multi-grade clusters of students 
and teachers. 

The Co-NECT organization reports that the 
approach is based on a large body of research on 
effective schools, primarily draw^ing from three 
research strands. First, it dravv^s from research 
showing that schools can improve student per- 
formance when the whole faculty focuses on 
achieving challenging, concrete, and measurable 
results. Second, it incorporates research linking 
increased student achievement with schools that 
allow teachers to take responsibility for a com- 



mon group of students and promote close, sus- 
tained relationships among teachers, students, 
and families. Third, it encourages authentic peda- 
gogy, which requires students to think, develop 
in-depth understanding, and apply academic 
learning to important, realistic problems. Accord- 
ing to the organization, the approach also incor- 
porates two other “best practices”: using multiple 
standards of assessment, and incorporating tech- 
nology in ways that enhance student learning. 

Co-NECT was founded in 1992 by members of 
the Educational Technologies Group at BBN 
(Bolt, Baranek, and Newman) Corporation. It is 
one of several approaches sponsored by New 
American Schools, a national initiative to develop 
replicable schoolwide reform programs. In the 
1998-99 school year, 75 schools in eight states 
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were using the approach. Of the 47 schools work- 
ing with the developer in the 1997-98 school year, 
there were 25 elementary schools, 15 middle 
schools, five high schools, one K— 8 school, and 
one K- 12 school. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Co-NECT is a 
relatively new approach and has not yet built a 
rigorous research base on student achievement. 
Two studies conducted by the Co-NECT orga- 
nization examined student outcomes; however, 
neither was considered rigorous enough to re- 
port the findings here. Co-NECT also is col- 
lecting and analyzing student outcome data 
gathered by districts. These longitudinal data 
can be obtained from participating districts and 
the developer. 

There is a strong base of research on implemen- 
tation. Seven studies (four conducted by inde- 
pendent researchers and three conducted by the 
developer) tracked the implementation progress 
of Co-NECT schools. 

Effects on Students. At the time of this report, 
there were no studies of sufficiently rigorous 
methodology on which to base conclusions about 
Co-NECT s effectiveness in increasing student 
achievement. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and 
Administrative Support. Co-NECT encourages 
significant organizational changes, based on 
research and best practices, but does not require 
any specific action. Schools are encouraged to 
reorganize into small communities of teachers 
and students from different grade levels 
(“clusters”). Parents, teachers, and students also 
are asked to form a school design team to help 
plan and implement reforms. Although not 
required, schools are encouraged to hire a local 
facilitator. 



Co-NECT also provides a full-time site director 
to work with a group of approximately five 
schools within a given geographic area. Accord- 
ing to Co-NECT, a site director visits each school 
regularly, conducts training workshops, and 
guides teams. Many site directors have been teach- 
ers or administrators in Co-NECT schools. 

Curriculum and Instruction. In the Co-NECT 
approach, students work on projects that can 
cover multiple content areas, solving real-life 
problems. According to the organization, this 
project work is designed to develop in-depth 
understanding in a range of content areas, higher- 
order thinking skills, and strong skills in read- 
ing, writing, and mathematics. Many projects 
apparently involve the use of technology, includ- 
ing using computers to share information with 
students in other schools and to communicate 
with experts in different fields. Students are ex- 
pected to demonstrate their skills and knowledge 
with products and presentations. 

Teachers are expected to develop three projects 
per year, using a common planning period to 
work together on them. Using the Co-NECT 
Exchange, the organizations Web site (www. 
co-nect.com), teachers can choose from projects 
developed by Co-NECT staff or other teachers. 
Examples of projects recently available are Why 
Vote? The Co-NECT Election Projecty a one month 
program for third through tenth grade, and The 
Underground Railroad Projecty a year-long project 
for third through eighth grade. 

Supplies and Materials. Two types of instruc- 
tional resources are seen as vital to the approach: 
a technology infrastructure, and materials for 
project-based instruction. The developer requires 
schools to provide Internet access for teachers so 
that they can access Co-NECT s online services. 
It encourages, but does not provide or require, 
computers on every teacher s desk and in every 
classroom, suggesting an optimal user-computer 
ratio of 5: 1 . No specific materials are required or 
provided for project-based instruction. 
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Scheduling and Grouping. Co-NECT does not 
require any specific grouping or scheduling 
changes. However, the developer encourages 
schools to set up a common planning time for 
teachers to plan projects together and to sched- 
ule blocks of time during the day for students to 
conduct group projects. 

To help students develop bonds with their teach- 
ers, Co-NECT recommends that students stay 
with the same teacher for at least two years. In 
this practice, called “looping,” a teacher follows 
a group of students from one grade to the next, 
and then starts over. For example, a teacher might 
teach fourth grade one year, fifth grade the next, 
and sixth grade the next, then “loop” back to 
fourth grade. 

Monitoring of Student Progress and Perfor- 
mance. Co-NECT calls for multiple forms of as- 
sessment, including standardized tests, student 
portfolios, exhibitions, classroom observations, 
and other indicators. The developer provides a 
comprehensive set of rubrics and a process for 
scoring student portfolios. The developer also 
helps schools develop assessments and provides 
workshops to help faculty use the assessment 
tools. 

Beginning in the 1998-99 school year, Co-NECT 
helps schools create schoolwide portfolios of stu- 
dent work. Co-NECT staff will train panels of 
community raters (for example, parents and busi- 
ness leaders) to evaluate the quality of students’ 
work and create a composite picture of student 
achievement that can accompany standardized 
test scores. 

Family and Community Involvement. Accord- 
ing to the developer, Co-NECT emphasizes par- 
ent and community involvement. Parents and 
community members are encouraged to volun- 
teer in the classroom and serve on the school 
design team or. the portfolio and implementa- 
tion review panels. Businesses are encouraged to 
provide schools with access to resources and to 
work with students on community projects, in- 
ternships, and other activities. 



SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. Co-NECT offers both on-site and online 
assistance to help participating schools implement 
five evaluation criteria (see the Implementation 
section, below) within a three-year period. In 
addition, Co-NECT schools participate in Criti- 
cal Friends, which provides an opportunity for 
schools to learn from each other. Each year, 
through Critical Friends, schools send three staff 
members to another Co-NECT district for three 
days to evaluate that school’s implementation of 
Co-NECT. 

Each year, Co-NECT begins with a two-day 
training session for faculty. Co-NECT provides 
three three-hour professional development ses- 
sions spread across the school year on topics such 
as standards-based projects, portfolio assessments, 
use of test results, and technology. According to 
Co-NECT, the sessions can be scheduled by the 
schools to take place during or outside of regular 
school hours during the school year. 

A Co-NECT site director provides regular on- 
site support, meeting with teachers during their 
common planning time, and coordinating three 
meetings per year with principals and district 
personnel. To meet other professional develop- 
ment needs, Co-NECT offers online training 
modules developed to meet needs identified 
across schools. 

Implementation Requirements and Schools’ 
Experiences. Before implementing Co-NECT, 
a school must meet several conditions. The Co- 
NECT organization requires that 75 percent of 
the faculty vote to adopt the approach. Co- 
NECT prefers to work with at least five schools 
in the district or region, to keep costs down, 
leverage resources, and ensure that the trans- 
forming schools are not isolated. The organiza- 
tion expects schools to have a concrete plan to 
ensure that they will have the necessary com- 
puters, networks, and software to implement the 
approach. 
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During each year of implementation, progress 
is reviewed against evaluation criteria in five 
areas: (1) high expectations for all students and 
schoolwide accountability for results; (2) 
schoolwide emphasis on practical application of 
academic knowledge to authentic problems; (3) 
use of assessments that measure actual student 
and school performance; (4) organization of the 
school into small houses of students and teach- 
ers from different grades; and (5) sensible use 
of the best available technology for everyone. 
The organization hopes that schools using the 
model will be able to continue on their own 
after three years of implementation; however, 
according to Co-NECT, schools may continue 
to participate in various Co-NECT activities 
after the third year. 

For the schools studied in the research, progress 
toward implementation was promising. In the 
first year of implementation, schools showed 
moderate progress, using some components of 
Co-NECT (project-based instruction, student 
portfolios, teacher teams, and Critical Friends). 
Multi-age grouping was not implemented in all 
Co-NECT schools during the first year. 

Two years after adopting Co-NECT, according 
to these studies, most of the central parts of the 
approach — instruction, standards, student assign- 
ment, and professional development — were 
consistent with Co-NECT s ideas. However, 
some schools still had not fully implemented the 
approach in regard to changing instruction across 
the curriculum, assessment, and community 
involvement. 

One study identified several obstacles to imple- 
mentation, including difficulty organizing the 
curriculum into projects and using technology 
to support the projects. 

Beginning in the 1998-99 school year, Co-NECT 
is coordinating reviews of implementation in Co- 
NECT schools. Similar to the Critical Friends 
process, a panel of stakeholders from the school 
board, community, and developers will evaluate 



the implementation of the approach against 
evaluation criteria in all Co-NECT schools. 

COSTS 

The first-year cost of adopting Co-NECT can 
be as high as $588,000. This cost covers profes- 
sional development, including staff release time; 
participation in the Critical Friends network; and 
an estimate for installing start-up technology in 
a school that has no hardware or software. 

An average school of 500 students pays Co- 
NECT $55,000 for each of the first three years. 
This fee covers the salary of the site director 
(which is shared across five or more schools), 
unlimited access to the Co-NECT Exchange, 
professional development, registration for three 
teachers at Co-NECT s national conference each 
year, and participation in the Critical Friends 
component (meals and hotel). 

Other costs differ by school, depending on the 
technology already in place, level of professional 
development needed, strategy for compensating 
teachers for professional development, and level 
of guidance needed to integrate school change 
with district strategies. 

Schools are responsible for additional expenses, 
including: travel and hotel costs for the national 
conference; release time and travel costs for Criti- 
cal Friends visits; release time for on-site train- 
ing; and compensation for teacher attendance 
outside of regular school hours. Co-NECT esti- 
mates that a school of 500 students will need 75 
substitute days in the first year and 65 days in 
each of the next two years for training. Critical 
Friends and the annual conference are estimated 
to cost $7,500 for each of the first two years and 
$6,500 for the third year (hotel and airfare). Travel 
expenses for the site director (if not local) are es- 
timated to be $4,800 for the first year and $3,500 
for each of the next two years. In addition, Co- 
NECT advises schools to budget time for teach- 
ers to develop projects for their classes. 
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The fee paid to Co-NECT does not cover hard- 
ware or software beyond the organizations Web- 
based tools and resources. The estimated cost for 
an average classroom, including a teacher pre- 
sentation station and four student stations, is 
$20,000. Co-NECT estimates that start-up tech- 
nology costs for an elementary school of 500 stu- 
dents with no wiring, hardware, or software could 
be as much as $500,000. According to the orga- 
nization, however, many schools and districts that 
work with Co-NECT have already made these 
technology investments. In addition to start-up 
costs, the school might expect to pay for Internet 
service, upgrades, and maintenance. 



CONTACT INFORMATION 

Ms. Tricia Ferry 
Co-NECT Schools 
70 Fawcett Street 
Cambridge, MA 02138 
Phone: 617-873-5612 
Fax: 617-873-2589 
E-mail: info@co-nect.com 
Website: http://www.co-nect.com 
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OVERVIEW 

Core Knowledge is based on the premise that 
people need a common base of knowledge to 
function well in a democratic society, and that 
schools are responsible for providing this base to 
every student. According to the developers, hav- 
ing a common base of knowledge allows indi- 
viduals to participate fully in society (e.g., by 
understanding news reports, or comprehending 
issues in an election). The developers also believe 
that it is particularly important for cmldreii from 
disadvantaged backgrounds to gain this core 
knowledge in school, because their exposure to 
learning opportunities outside of the classroom 
may be limited. Core Knowledge is grounded in 
research on learning which shows that individu- 
als gain knowledge by “attaching” new informa- 



tion to what they already know. Children who 
lack certain knowledge when they enter school 
are at risk of falling further behind their class- 
mates as they progress through school. One goal 
of Core Knowledge, therefore, is to narrow the 
gap between children from different backgrounds 
by providing all students with the same “mental 
velcro” upon which to attach new knowledge. 

According to the developers, providing a core of 
grade-level content in every school has the added 
benefit of ensuring that children who transfer in 
and out of Core Knowledge schools will be taught 
the same material in their new school. Without 
this core content, children who are frequently 
transferred face gaps in their knowledge that may 
set them behind their new classmates perma- 
nently. Typically, children from disadvantaged 
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backgrounds are more likely to transfer frequently, 
which makes Core Knowledge all the more im- 
portant for this population of students. 

The centerpiece of the approach is the Core 
Knowledge Sequence ^ a 200- page outline of the 
specific content that should be taught in each 
subject, each year, from kindergarten through 
eighth grade. The Sequence covers language arts 
(or English in grades six through eight), world 
history and geography, American history and 
geography, visual arts, music, science, and math- 
ematics. Although the Sequence Atidils what con- 
tent should be taught, it does not specify how 
content should be taught. Instructional strate- 
gies are left up to individual teachers. 

Core Knowledge is supported by the Core 
Knowledge Foundation, an independent, non- 
profit organization established in 1986. The 
Foundations primary program, the Core Knowl- 
edge Sequence^ was first used in schools in 1990. 
Core Knowledge is now used in over 750 schools 
in 43 states and the District of Columbia. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Of the seven stud- 
ies on Core Knowledge available, all conducted 
by independent researchers, three focused both 
on implementation and student achievement 
outcomes, one examined student achievement 
only, and three examined implementation only. 
Three of the four studies examining student out- 
comes were considered sufficiently rigorous to 
report here. The implementation research in- 
cludes two case studies describing schools that 
use Core Knowledge. 

Results from a national evaluation of this 
approach are expected in 1999. However, all three 
of the rigorous studies that are currently available 
report student outcomes for Maryland schools 
only. 

Effects on Students. Overall, there is promising 
evidence of positive student achievement effects 



in elementary schools. After one year of imple- 
mentation, Core Knowledge students tended to 
have greater gains than students in matched com- 
parison schools in reading comprehension and 
math concepts on the Comprehensive Test of 
Basic Skills. In reading, students in four of five 
Core Knowledge schools showed greater gains 
than those in comparison schools. In the remain- 
ing school, implementation of Core Knowledge 
was poor, and students showed a decrease in per- 
formance compared to a control school. For 
mathematics, in one case, students at a Core 
Knowledge school showed greater gains than con- 
trol students; in three cases, gains were similar. 
At the poor implementation site, math scores 
declined significantly in comparison to a control 
school. 

Using the same sample, comparisons between 
control and Core Knowledge schools on the 
Maryland School Performance Assessment Pro- 
gram (MSPAP) assessment were also examined. 
Findings were consistent for the first- and third- 
year evaluations. Students in five Maryland Core 
Knowledge schools had significantly higher gains 
in all subjects except science for fifth graders com- 
pared to control schools. Science, which was not 
emphasized by teachers in Core Knowledge 
schools, was the only tested subject for which 
Core Knowledge schools did not perform as well 
as the comparison schools. 

A third study showed a positive trend for Core 
Knowledge students on the Iowa Test of Basic 
Skills. However, the difference between Core 
Knowledge students and comparison students 
was only significant on one subtest, language, in 
one year. Core Knowledge students did not per- 
form as well on a writing exercise, compared to 
students in similar schools. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. There are no specific require- 
ments for increased staff. However, because the 
approach emphasizes music and art, schools that 
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do not have music or art teachers may wish to 
hire them. 

The developers recommend that teachers have 
common planning time to implement Core 
Knowledge. Because the material that is taught 
in each grade builds directly upon what was 
taught the prior year, teachers need to work 
together across grade levels to ensure that what 
they are teaching flows from one year to the next. 
Additionally, teachers within the same grade need 
to ensure that they are consistent in what they 
teach so that all students are given the same 
foundation. 

Curriculum and Instruction. The Core Knowl- 
edge Sequence provides a curriculum framework 
that specifies the content schools are required to 
cover in each grade. Core Knowledge does not, 
however, specify which instructional strategies or 
materials should be used. Sample lesson plans, 
developed by Core Knowledge teachers around 
the curriculum, are available through the Core 
Knowledge Web site. 

As described previously, the Core Knowledge Se- 
quence covers language arts (or English in grades 
six through eight), world history and geography, 
American history and geography, visual arts, 
music, science, and mathematics; it does not cover 
physical education, health, or foreign languages. 
Each subject is taught from kindergarten through 
eighth grade so that students have a base of in- 
formation on which to build. (A pre-K curricu- 
lum also is available.) The Sequence is very spe- 
cific: the kindergarten poetry section, for ex- 
ample, lists 37 “Mother Goose and other tradi- 
tional poems” (e.g., London Bridge Is Falling 
Down) and 11 “other poems” (e.g., A. A. Milne, 
The More It Snows) that are to be covered; the 
fiction section specifies 18 stories, four Aesop s 
fables, two American legends and “tall” tales, and 
two literary terms. The Sequence is not an ex- 
haustive list, however, and the developers encour- 
age teachers to supplement listed readings with 
additional content. 



The Core Knowledge Sequence is designed to take 
50 percent of total instructional time, with 
schools using the remaining time to cover topics 
required by state and local standards, such as state 
and local history and geography. According to 
the developers, however, in practice, most schools 
find that the initial years of implementation re- 
quire spending more time on the Core Knowl- 
edge Sequence, Over time however, schools work 
to align the Core Knowledge Sequence with state 
and local standards, leaving more time for supple- 
mental work. 

Supplies and Materials. Core Knowledge does 
not provide or specify the instructional materials 
that should be used. Instead, the approach is de- 
signed so that schools can build on existing sup- 
plies and materials. According to the developers, 
however, schools typically do not have enough 
existing materials to teach the Core Knowledge 
content properly, and have to purchase additional 
materials for their classrooms and libraries. Most 
often, schools have to purchase books or maps. 

Core Knowledge produces optional materials 
schools can purchase. For example, compact 
discs are available for pre-K through eighth grade 
from the Core Music Collection (the kindergar- 
ten collection includes Classics for Kids, Peter and 
the Wolf, and The Best of Grieg), as are Core Clas- 
sics books (such as Robinson Crusoe or Gulliver's 
Travels), 

The Core Knowledge Sequence, described above, 
is an essential supply for all teachers. In addi- 
tion to the Sequence, the Core Knowledge Foun- 
dation produces a series of books for parents 
and teachers called What Your ... Grader Needs 
to Know covering each grade level. These books 
provide an introduction to the knowledge out- 
lined in the Sequence, The series also suggests 
related reading and resources for teachers to use 
in their classrooms. 

Scheduling and Grouping. Core Knowledge rec- 
ommends that students be taught in whole groups; 
however, many schools also assign individual and 
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group projects to students. There are no guide- 
lines for class size; developers assume that schools 
will maintain their current class sizes (i.e., between 
1 8 and 24 students). There are no specific require- 
ments for scheduling classes or school days. 

Monitoring Student Progress. Currently, there 
are no guidelines for monitoring student progress 
or performance. According to the developers, 
Core Knowledge is developing tests to be admin- 
istered by teachers to assess the full Core Knowl- 
edge Sequence, These assessments should be avail- 
able in 1999. 

Family and Community Involvement. Although 
there are no explicit requirements for involving 
family and community, one study found that 
strong family and community support facilitated 
successful implementation in a number of schools. 
Some teachers send outlines of the material that 
they are going to cover each month to parents, so 
they will feel more informed about their child’s 
education. Some schools involve parents by re- 
questing their assistance in locating resources to 
use in the classroom. (Involving parents in this way 
also reduces the time that teachers have to spend 
finding information and resources.) 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. The emphasis of Core Knowledge profes- 
sional development is to enhance teachers’ knowl- 
edge of the subjects they teach. Therefore, Core 
Knowledge encourages teachers to enroll in col- 
lege courses in their field. Core Knowledge also 
encourages schools to take advantage of resources 
in the community, such as having a local physi- 
cian give a lecture to teachers on the circulatory 
and lymphatic systems. 

The Core Knowledge Foundation offers work- 
shops, conducted by trained teachers or admin- 
istrators from Core Knowledge schools. In larger 
districts, there may be an approach facilitator who 
is encouraged to attend these workshops. The 



developers offer a half-day overview workshop 
to introduce the approach. This may be followed 
by Getting Started, a one-and-a-half day work- 
shop to familiarize teachers with the topics taught 
at all grade levels. Topics in this workshop in- 
clude comparing what is currently taught to what 
is taught in the Core Knowledge Sequence^ devel- 
oping a schoolwide plan for implementation, 
learning how to align Core Knowledge content 
with district and state requirements, developing 
a monthly planning guide, finding time to plan, 
locating resources, and involving parents and 
community members. 

A three-day Developing Core Knowledge Units 
workshop for teachers covers the process of writ- 
ing Core Knowledge units, focusing on: inte- 
grating concepts, content, and skills; developing 
background knowledge; selecting resources; de- 
veloping effective instructional procedures and 
activities to meet objectives; and identifying as- 
sessment methods. 

The developers visit the schools to provide tech- 
nical assistance. The number of visits, specified 
in a contract with the school, is typically three to 
five per year. 

Other resources include an annual national con- 
ference and regional technical assistance centers. 
An Internet discussion group called Core-Net also 
provides a forum for Core Knowledge teachers 
and parents to communicate with each other. 
Participants can share lesson plans and units, ask 
or answer questions, or discuss how Core Knowl- 
edge is working in their schools. Finally, the Core 
Knowledge Web site provides sample lesson plans, 
research findings, and articles from the Core 
Knowledge newsletter, Common Knowledge, 

Implementation Requirements and Schools’ Ex- 
periences. Schools interested in adopting the 
Core Knowledge approach should contact the 
Core Knowledge Foundation to obtain informa- 
tional materials. The method by which schools 
arrive at the decision to adopt Core Knowledge 
varies from school to school, but the developer 
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recommends that the decision be a joint effort 
between administrators and instructional staff 
After deciding to become a Core Knowledge 
school, all instructional staff may attend an op- 
tional Core Knowledge Overview workshop, gen- 
erally held at the school, which describes the back- 
ground, results, and benefits of Core Knowledge, 
and what a school must do to become involved. 
The developer requires schools to submit a plan 
for implementing the program, including a sched- 
ule of implementation goals. 

A review of four studies addressing implementa- 
tion suggests that, although some teachers expe- 
rienced initial reservations about using the ap- 
proach (some were afraid that they did not know 
the new content well enough to teach it), most 
seemed energized by the opportunity to enhance 
their own knowledge and thereby increase the 
knowledge of their students. Specifically, teach- 
ers noted increased cooperation among col- 
leagues. For example, as a result of teaching the 
same content, teachers may be able to share re- 
sources in ways not previously established. Ac- 
cording to the developers, full implementation 
has been shown to be possible in three years. 

Findings from these studies also suggest that 
teachers new to a Core Knowledge school may 
have difficulty, both because staff development 
time and funding typically decrease over time, 
and because departing teachers do not always 
leave their lesson plans. Teachers spend approxi- 
mately four hours per week developing their les- 
sons; this time commitment, however, decreases 
after several years. One common concern voiced 
by teachers is the difficulty of finding age- 
appropriate materials for their students. 

In terms of covering the Core Knowledge con- 
tent, one study found that, although instructional 
style varied from class to class, teachers were cov- 
ering the same content. Studies show that teach- 
ers in first and second grade cover a higher per- 
centage of the core content. One reason for this 
may be that, in higher grades, the district require- 
ments are stricter, leaving less time for the Core 



content. In one study, teachers in five Core 
Knowledge schools reported that they were 
spending, on average, 53 percent of total instruc- 
tional time covering the Core content, close to 
the 50 percent that the developers recommend. 
However, one study found that, in the first year, 
it was difficult to teach all of the Core Knowl- 
edge content because of conflicts with existing 
district requirements. 

COSTS 

The first-year cost of adopting Core Knowledge 
is $56,000. This cost covers professional devel- 
opment, including staff release time; materials; 
and a membership fee. 

The cost of implementing Core Knowledge var- 
ies greatly from school to school. There are a few 
nominal costs that each school must pay, but the 
more significant expenses depend on the amount 
of additional resources and materials that must 
be purchased to supplement the materials cur- 
rently available at the school. 

Each school pays a small fee to become a mem- 
ber of the Core Knowledge Network. A one-year 
membership costs $15; a two-year membership 
costs $25. In addition, every teacher in the school 
must have a personal copy of the Core Knowledge 
Sequence, which costs $25 per copy. Many schools 
also purchase the series What Your , . . Grader Needs 
to Know. These books, however, are not required 
(and it is not necessary for teachers to have per- 
sonal copies). 

Schools also may pay for optional workshops. The 
first, an overview of Core Knowledge, costs $500, 
regardless of the number of participants. The 
other workshops vary in price, depending upon 
how many teachers aitend: for up to 25 teachers, 
the price is $750 per day; for 25 to 50 teachers, 
the price is $1,000 per day; and for more than 
50, the price is $1,250 per day. As described 
above, the first workshop is one and a half days 
and the second workshop is three days long. In 
addition to the price of the workshops, when 
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schools sign up for the overview workshop, they 
pay a one-time fee of $50 per person, which cov- 
ers the materials used in all the workshops. 
Schools must cover travel, lodging, and meals for 
the workshop presenters as well as release time 
for teachers. Schools contract with the develop- 
ers for technical assistance visits; on average, 
schools spend $5,000 for these visits. 

The primary cost of implementing Core Knowl- 
edge is for additional instructional materials, such 
as books, maps, and videotapes. The developers 
estimate that many schools will have to pay over 
$10,000 to purchase sufficient materials to teach 
the Core Knowledge Sequence. This is not a one- 
time expense; schools will have to continue to 
budget for additional materials or to replace ma- 
terials that have worn out. 

One implementation study of five sites found that 
most of the schools obtained foundation start-up 
grants that allowed them to purchase materials and 
to send teachers to conferences and to visit other 
Core Knowledge schools. This study also found 



that teachers typically were not given paid time to 
prepare their lessons before implementing Core 
Knowledge; however, many schools did give teach- 
ers time during the school year (one hour per week, 
for example) to work in teams. 



CONTACT INFORMATION 

Dr. Constance Jones 

Director of School Programs 

Core Knowledge Foundation 

801 East High Street 

Charlottesville, VA 22902 

Phone: 804-977-7550 

Fax: 804-977-0021 

E-mail: jonescore@aol.com 

Web site: http://www.coreknowledge.org 
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OVERVIEW 

The goals of Different Ways of Knowing are to 
raise academic achievement and improve stu- 
dents’ attitude toward school. The developer ad- 
vocates building on the “multiple intelligences” 
of students, to develop their skills in various do- 
mains (e.g., logic and mathematics, language, 
social skills, and artistic skills). According to the 
developer, the approach is built around a variety 
of research bases, including: cognitive research, 
the effects of early and sustained intervention, 
and research on motivation and classroom envi- 
ronments. In addition, the approach is based on 
research that supports using thematic, integrated 
instruction and incorporating artistic experiences. 
The approach is designed to serve students in 
kindergarten through seventh grade. 



Different Ways of Knowing is an approach that 
attempts to combine three elements — a philoso- 
phy of education, a curriculum, and professional 
development activities. The education philoso- 
phy emphasizes positive expectations for students, 
thematic and interdisciplinary instruction, active 
student participation, early intervention, and 
parent involvement. The curriculum, which is 
organized around history and social studies, seeks 
to integrate the arts, literature, science, math, and 
technology. Professional development ^?ctivities> 
involving a three-year course of study for instruc- 
tional staff, are designed to foster professional 
growth and community building. 

Different Ways of Knowing was developed in 
1989 by the Galef Institute, a nonprofit educa- 
tional organization dedicated to comprehensive 
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school reform. The developer field-tested Dif- 
ferent Ways of Knowing in more than 500 class- 
rooms over four years; the approach now is used 
in more than 412 schools in California, Florida, 
Kentucky, Michigan, Mississippi, Pennsylvania, 
and Washington. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. The research base 
for Different Ways of Knowing is promising. Four 
studies on student achievement outcomes were 
reviewed for this report; all were considered suf- 
ficiently rigorous to report findings here. The 
studies included a district study spanning several 
years, a study of four schools, analysis of data from 
84 Kentucky schools, and a set of three subsid- 
iaries in Kentucky. All of the studies were con- 
ducted independently (although the developer 
helped researchers secure funding in several cases). 
Most of the studies have detailed information on 
implementation as well. More than 89 elemen- 
tary schools were examined in these studies, in- 
cluding schools in a variety of locations. 

Effects on Students. The four rigorous studies 
with data on student achievement show evidence 
of mixed effects for the approach. The strongest 
gains were in language arts, where students gained 
8 percentile points for every year that the school 
used the approach. Reading achievement im- 
proved in Different Ways of Knowing schools 
according to one study, and declined slightly ac- 
cording to another study. Demonstration schools, 
known to be especially well implemented, show 
higher reading score gains than other schools. 
Mathematics achievement improved in Differ- 
ent Ways of Knowing schools, especially demon- 
stration schools, according to three studies. Dif- 
ferent Ways of Knowing students score higher 
(on both pre- and post-tests) in social studies than 
comparison students, but the advantage might 
not be due to the approach; except in the study 
on demonstration schools, comparison students 
gained more. 



Finally, a study of schools with Title I schoolwide 
funds found that schools in which over 75 per- 
cent of teachers used Different Ways of Know- 
ing had higher average gains than those in which 
a smaller percentage of teachers used the ap- 
proach. However, when all types of schools were 
examined, schools in which 75 percent of teacher 
used the approach had gains similar to those of 
schools in which a smaller percentage of teachers 
used the approach. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Different Ways of Knowing 
promotes instructional practices that should re- 
quire little change in school organization or staff- 
ing. However, support from district and school 
administrators is considered essential, to ensure 
that there are sufficient funds for professional de- 
velopment and to ensure that teachers have flex- 
ibility for planning and collaboration with other 
teachers. Schools are encouraged to have a liai- 
son at the school or in the district central office 
to work with Different Ways of Knowing staff 
The developer prefers to work with several schools 
in a district, to ensure long-term, collaborative 
support from the district. 

Curriculum and Instruction. At the heart of 
Different Ways of Knowing are instructional 
strategies that are designed to build on students’ 
existing knowledge and skills and to promote 
interaction among students. Students are en- 
couraged to engage in hands-on activities (e.g., 
interview people and conduct research projects). 
The developer provides teachers with a plan- 
ning guide that includes content to be covered, 
based on standards of achievement; instructional 
strategies (e.g., ideas for group and individual 
learning activities); and resources for students 
(e.g., children’s literature, reference documents, 
historical search guides for student research). 

According to the developer, lessons are built 
around themes, integrating history and social 
studies with the visual and performing arts, lit- 
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erature, writing, mathematics, and science. The 
developer believes that infusing arts across all dis- 
ciplines ensures that instruction is accessible to 
all students. 

Supplies and Materials. The developer provides 
instructional staff with curriculum modules that 
are aligned with state standards in history and 
social studies. Teachers are encouraged to choose 
their own pathways through the curriculum 
modules, based on the needs of their students. 

The developer also provides instructional staff with 
a variety of materials, including planning guides 
on interdisciplinary instruction and strategies for 
teaching at-risk students. In addition, the devel- 
oper provides a library of thematically organized 
and culturally diverse children s literature and ref- 
erence books; historical documents, maps, videos, 
and other related media; and literature detailing 
“best practices” in all subject areas. 

Scheduling and Grouping. Different Ways of 
Knowing does not require a particular method 
of classroom grouping (e.g., homogeneous or 
heterogeneous), but the developer encourages 
schools to include students with special needs in 
the regular classroom. 

Monitoring of Student Progress and Perfor- 
mance. Different Ways of Knowing advocates 
continuous monitoring of student performance. 
The developer believes that there are different 
ways for students to demonstrate their under- 
standing, and encourages multiple methods of 
assessment, including demonstrations of student 
ability through written, oral, artistic, dramatic 
and physical expression, as well as through port- 
folios of student work. 

Family and Community Involvement. Different 
Ways of Knowing emphasizes involvement of 
family and community. Teachers are encouraged 
. to see their work in school as integrated with home 
and community activities. The curriculum guides 
teachers and students in classroom and 
community-based problem-solving, which are 
developed to help students see a clear link between 



school, community, and future career oppor- 
tunities. In addition. Different Ways of Knowing 
schools organize Parent Nights, where parents 
participate in hands-on activities to experience 
firsthand what and how their children are learning. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical As- 
sistance. The developer supports a wide range 
of school and district planning and training. 
Each school is matched with an interdiscipli- 
nary support team on the developers staff, in- 
cluding teachers experienced in classroom 
implementation of the approach. The team, led 
by a Site Implementation Coach, facilitates all 
professional development, including on-site and 
online coaching. Coaches provide monthly site 
visits, which include demonstrations of instruc- 
tional methods, observation and debriefing, 
support with classroom management, assess- 
ment, and other classroom strategies. Over time, 
schools are expected to develop internal capac- 
ity for these functions. Additional assistance is 
available as needed. 

Other professional development activities in- 
clude an annual three-day summer institute for 
instructional staff, administrators, parents, and 
community members. A variety of optional 
three- to four-day workshops offer training in 
the teaching strategies associated with Differ- 
ent Ways of Knowing. An interactive Web site 
(www.dwoknet.galef org) also is available to help 
deliver coaching and assistance, as well as to al- 
low educators to share information as they 
implement the approach. 

Implementation Requirements and Schools’ Ex- 
periences. Schools must agree to a number of 
conditions before becoming a Different Ways of 
Knowing school. Specifically, they must: (1) com- 
mit to working with Different Ways of Knowing 
for multiple years; (2) allocate time for profes- 
sional development; (3) attempt to integrate re- 
form initiatives, curriculum programs, and fam- 
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ily programs at the classroom level; (4). work to 
integrate the programs philosophy and practices 
into their reform plans; (5) build an evaluation 
plan; (6) design a process for sustaining and 
spreading successful practices; and (7) designate 
school community and district advisory teams to 
work closely with the developer and participat- 
ing schools. 

Coaches and site facilitators support the continual 
assessment and review of Different Ways of 
Knowing implementation. The developer works 
with schools and districts to tailor an evaluation 
and documentation plan to meet individual 
school needs. Developer involvement continues 
for three to five years and is geared to building a 
schools capacity to sustain the approach. 

The research on implementation indicates that 
the approach does affect the instructional strate- 
gies of teachers. For example, one study showed 
that Different Ways of Knowing teachers tended 
to use more “student-centered” instruction (e.g., 
student-initiated discussion), integrate more than 
one subject in lessons, and employ more “hands- 
on” activities. 

One study suggests that the approach is difficult 
to implement fully, however, finding that in 173 
of 272 schools using Different Ways of Knowing 
in Kentucky, less than 75 percent of school staff 
were involved in implementing the approach. 

COSTS 

The first-year cost of adopting Different Ways of 
Knowing is $84,000. This cost covers professional 
development, including staff release time, and 
other services provided by the developer. 



The average fee for Different Ways of Knowing 
is $35,000 per school for each year of the three- 
year implementation. Other expenses include 
release time for professional development (an 
average of three days in the summer and four 
days during the year) and teachers’ time for cur- 
riculum planning, study groups, and on-site 
coaching sessions. Schools located outside regions 
with many Different Ways of Knowing schools 
should allow for additional travel costs. Any de- 
sired independent evaluation, additional leader- 
ship training, pre-service partnerships with local 
universities and colleges, or summer school sup- 
port would add to program costs. 

The developer works closely with schools and 
school systems to identify diverse funding sources 
and secure public as well as private funding 
sources. 



CONTACT INFORMATION 

Ms. Sue Beauregard, Vice President, or 

Ms. Amy Berfield, Vice President of State 
and Local Partnerships 

The Galef Institute 

11050 Santa Monica Boulevard 

Third Floor 

Los Angeles, CA 90025-3594 
Phone: 310-479-8883 
Fax: 310-473-9720 

E-mail: sue@galef org or amy@galef org 

Web site: http://www.dwoknet.galeforg/ 
dwok.html 
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Direct Instruction 



Evidence of positive effects on student achievement 


• 


Year introduced in schools 


Late 1960s 


Number of schools 


150 


Support developer provides schools 


3 


First-year costs 




with new staff 


$244,000 


with current staff reassigned 


$194,000 


® = Strong (J = Promising (i = Marginal O = 


Mixed, Weak ?= No Research 



OVERVIEW 

The primary goal of Direct Instruction is to in- 
crease student achievement through carefully fo- 
cused instruction. In this approach, instruction 
involves identifying particular skills and show- 
ing students how to apply these skills in increas- 
ingly complex situations. The Direct Instruction 
model aims to provide intense, efficient lessons 
that will allow all children — even the lowest per- 
forming — to master academic skills. 

Direct Instruction provides a model of instruc- 
tion that emphasizes the use of carefully planned 
lessons, designed around a highly specified knowl- 
edge base and a well-defined set of skills for each 
subject. A central element of the theory underly- 
ing Direct Instruction is that clear instruction 
eliminates misinterpretations and can greatly im- 
prove and accelerate learning. 



Direct Instruction grew from work on teacher- 
directed instruction begun by Siegfried Engelmann 
at the University of Illinois in the late 1960s and 
continued at the University of Oregon. There are 
currently several providers who contract with 
schools and districts on the implementation of this 
approach. The curriculum materials are published 
by Science Research Associates, a division of 
McGraw-Hill. Although the original focus was on 
reading, language, and math, the program has been 
expanded to include social and physical science, 
fact learning, and handwriting. The Direct Instruc- 
tion model serves students in kindergarten through 
sixth grade in 150 schools and several thousand 
individual classrooms nationwide. It has been 
widely used among low-performing schools in 
high-poverty areas, but is marketed for all students. 
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EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Direct Instruc- 
tion has a lengthy and rich base of empirical re- 
search. Eighteen studies describing the student 
achievement effects of Direct Instruction were 
available for this profile, including two research 
syntheses; nine of these studies also reported in- 
formation on implementation. Of these, all but 
four scored high in the ratings of research 
strength. Not only is there a great deal of strong 
research on this approach, but there are many 
studies with similar findings, which raises confi- 
dence in the results. Further, of the 14 studies 
that used rigorous methodologies, five were con- 
ducted by independent researchers. 

There are minor weaknesses with the research on 
Direct Instruction that should also be noted. First, 
the outcome research has focused more on read- 
ing and math than the other subjects that consti- 
tute the Direct Instruction curricula. Second, a 
great deal of the Direct Instruction research is 
over 10 years old. Only seven of the 37 studies 
covered in a recent analysis of the research on 
Direct Instruction were done in the 1990s, and 
several date back to the 1970s. 

Effects on Students. Overall, there is strong evi- 
dence that Direct Instruction has a positive ef- 
fect on student achievement. Adams and 
Engelmanns analysis (1996) showed that 32 of 
the 34 studies qualifying for inclusion in their 
meta-analysis demonstrate that Direct Instruc- 
tion has a positive effect on student achievement. 
Their review found that Direct Instruction is 
effective in improving overall achievement, as 
well as achievement in language, reading, math- 
ematics, spelling, health, and science. Several 
other studies, moreover, confirm and reinforce 
these findings. Of those studies reviewed for this 
profile, seven support Direct Instructions posi- 
tive effect on reading, 1 1 on mathematics, nine 
on language, and four on affective behavior and 
social skills. Direct Instruction also appears to 
improve chances for later success (e.g., gradua- 



tion rates, application and acceptance to col- 
lege rates). Research also suggests that students 
who begin Direct Instruction with low IQs seem 
to progress at the same rate as students who 
begin Direct Instruction with higher IQs (i.e., 
the approach is effective for both high- and low- 
achieving students). 

Two studies investigated the relationship between 
the level of implementation of Direct Instruc- 
tion and student performance on standardized 
tests. Using the Direct Instruction Supervision 
Code (DISC), these studies found a positive re- 
lationship between teacher ratings (i.e., level of 
implementation in a classroom) and student per- 
formance on standardized achievement measures 
(e.g., the Comprehensive Test of Basic Skills read- 
ing assessment). However, the relationship var- 
ied depending on the component of the Direct 
Instruction approach being measured (e.g., pac- 
ing, format, correcting students). 

Direct Instruction also appears to improve stu- 
dents affective behavior and social skills: self-es- 
teem/concept, attitudes toward self and school, 
attribution of success or failure to self or outside, 
and sense of responsibility.^ 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Direct Instruction makes lim- 
ited organizational demands on schools. The most 
significant is a recommendation that all teachers 
of reading and English language arts be sched- 
uled to teach that subject at the same time. This 
practice, which allows for cross-class grouping, 
also may be followed for other subject areas, de- 
pending on the implementation. 

The developer encourages each school to have a 
peer coach (facilitator) to help instructional staff 
implement the program. Principals are expected 
to fulfill the scheduling requirements and moni- 
tor classroom activities. For multi-school imple- 
mentations, districts are encouraged to delegate 
a project coordinator to serve as an accountabil- 
ity officer and administrative problem solver. 
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Curriculum and Instruction. The curriculum 
and methods of instruction are the most impor- 
tant aspects of Direct Instruction. Direct Instruc- 
tion provides highly scripted and interactive les- 
sons geared towards small, homogeneously 
grouped students. The reading, language arts, and 
math curricula can be used separately. Direct In- 
struction also covers science, social science, fact 
learning (cultural literacy), and handwriting. 

Supplies and Materials. Schools must buy the 
required curriculum materials from the publisher. 
Teachers use “presentation books,” spiral-bound 
lesson plans that enable highly scripted, rapid- 
paced instruction. Within these presentation 
books are instructions for monitoring and 
assessing student progress, and for providing 
immediate feedback to students. The model also 
offers materials designed specifically for older 
students who have not mastered basic skills. 

Scheduling and Grouping. Students are grouped 
homogeneously for specific subjects. As some stu- 
dents may be weak in one subject and strong in 
another, the groups may be different for differ- 
ent subjects. Thus, some implementations en- 
courage each major subject to be taught at a spe- 
cific time to allow for cross-grouping. 

Monitoring Student Progress and Performance. 
A placement test is used for initial assignment of 
students by performance level. The pace of in- 
struction is set according to the performance level 
of each group. Since Direct Instruction relies so 
heavily on grouping students by achievement lev- 
els, frequent assessment of student progress is 
essential. According to the developer, teachers 
monitor student performance every five to 10 
days, using such methods as calculating reading 
rates and error ratios. These data, as well as weekly 
grades, are used to regroup students according to 
level. Schools also continue to use state and lo- 
cally mandated achievement tests. 

Family and Community Involvement. Direct In- 
struction does not require family or community 
involvement. However, the developers recom- 
mend involving parents, by having parents use a 



Parent and Child Home Practice Guide to work 
on their child’s skills at home. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. Professional development and technical 
assistance, consisting of training and in-class 
coaching, are essential elements of Direct Instruc- 
tion. The developer recommends one week of 
training in Direct Instruction methods prior to 
implementation. During the school year, at least 
four days per month of coaching, observation, 
and modeling are recommended. In addition, the 
developer recommends weekly one-hour inservice 
sessions during which teachers may learn and 
practice Direct Instruction techniques. 

The quantity, quality, pace, and content of pro- 
fessional development vary widely, depending on 
the contractor. However, as a general rule, the 
first year of implementation emphasizes training 
in strategies for assessing and instructing students, 
a schoolwide discipline program, and a single aca- 
demic subject or pair of related subjects (usually 
reading or reading and language arts, for ex- 
ample). During the second year, teachers might 
be trained in the remainder of the curriculum, as 
well as more diagnostic and instructional strate- 
gies. The third years training might focus on 
mastering the basics of Direct Instruction and 
introducing techniques for “hard-to-teach stu- 
dents.” According to the developer, local teach- 
ers should be trained to coach and supervise so 
that after a period of three to five years, schools 
can be self-sufficient. 

Implementation Requirements and Schools’ Ex- 
periences. Although not required, the developer 
recommends that teachers vote to adopt Direct 
Instruction and discontinue any programs that 
conflict with it. Implementation then follows the 
path described under Professional Development 
and Technical Assistance. 

Two studies provide details on implementation of 
Direct Instruction in a single sample of inner-city 
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elementary schools at different points in time. In 
these case studies of implementation, the school 
began to implement Direct Instruction over the 
summer and had less than two months to prepare. 
Thus, teachers, upon arriving for the new school 
year, had the challenge of implementing an ap- 
proach with which they were not familiar, based 
on only two days of training. 

According to the research, initial resistance to 
Direct Instruction can be high. Teachers may dis- 
like the highly structured approach of Direct In- 
struction and unannounced visits and “correc- 
tion” given by Direct Instruction staff. However, 
according to interviews with teachers after one 
and two years of implementation, teachers gradu- 
ally developed a more positive attitude toward 
the program, with many citing the positive re- 
sults that they had seen in students (e.g., im- 
proved rest scores, better attitudes). Although 
some teachers continued to espouse ideological 
differences with the program’s highly-scripted 
philosophy, most had accepted the program. 
Studies suggest that the project manager (and/or 
implementation provider) has a large influence 
on the success of the approach. 

COSTS 

The first-year cost of adopting Direct Instruc- 
tion is $244,000. This cost covers professional 
development, including staff release rime, mate- 
rials, and additional staff However, schools can 
reduce this cost to $194,000 by reassigning a 
current staff member to serve as the facilitator. 

An average school of 500 students and 20 to 25 
teachers will incur costs for Direct Instruction for 
training and technical assistance, personnel, and 
materials. The developer estimates that technical 
assistance will cost $65,000 a year for three to five 
years. This includes direct costs for faculty train- 
ing at the start of and during the school year. It 
does not include the cost of faculty time devoted 
to training. Release time is needed for instruc- 
tional staff who will eventually serve as coaches 
and trainers. This amounts to five days of pre- 



implementation at the start of the school year for 
the entire faculty, plus at least one hour per week 
(or approximately 4.5 days per year) for each 
teacher. In addition, the developer requires schools 
to regularly submit data on student progress, 
which might require additional staff time. In ad- 
dition, instructional materials, available from Sci- 
ence Research Associates, cost about $125 per stu- 
dent, or $62,500 for a school of 500 students. 

CONTACT INFORMATION 

Implementers: 

Mr. Bob Fox 

National Institute for Direct Instruction 
805 Lincoln Street 
Eugene, OR 97401 
Phone: 541-485-1973 
Fax: 541-683-7543 

Ms. Kendra Feinberg 

JP Associates 

131 Foster Avenue 

Valley Stream, NY 11580 

Phone: 516-561-7803 

Fax: 516-561-4066 

Web sire: www.jponline.com 

Information Clearinghouse: 

Mr. Bryan Wickman 
Association for Direct Instruction 
P.O. Box 10252 
Eugene, OR 97440 
Phone: 541-485-1293 
Fax: 541-683-7543 

Web sire: www.adihome.org 

Ms. Melissa Hayden 

Direct Instruction Center East 

College of Education, Indiana University 

of Pennsylvania 

104 Srouffer Hall 

Indiana, PA 15705 

Phone: 724-357-4836 

Fax: 724-357-5595 

E-mail: Mhayden@grove.iup.edu 
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Expeditionary Learning 
Outward Bound 



Evidence of positive effects on student achievement 


3 


Year introduced in schools 


1992 


Number of schools 


65 


Support developer provides schools 


• 


First-year costs 




with new staff 


$81,000 


with current staff reassigned 


No change 


® = Strong 3 = Promising (i = Marginal 0 = 


Mixed, Weak ?= No Research 



OVERVIEW 

Expeditionary Learning Outward Bound is a 
comprehensive school design that aims to trans- 
form curriculum, instruction, assessment, and 
school culture and organization. It is based on 
two central ideas: that students learn better by 
doing than by listening; and that developing char- 
acter, high expectations, and a sense of commu- 
nity is as important as developing academic skills 
and knowledge. 

Expeditionary Learning involves five core prac- 
tices. The first is learning expeditions, long-term, 
multidisciplinary projects that combine aca- 
demic, service, and physical elements. The sec- 
ond practice is reflection and critique, which in- 
volves teachers working with each other to ex- 
amine their own instruction and students’ work. 



Third, the school culture emphasizes community 
and collaboration, high expectations for all stu- 
dents, service, and diversity. Fourth, the school 
structure is reorganized to share decision making 
among teachers and administrators and to de- 
velop relationships among staff, students, parents, 
and the community. The fifth practice is school 
review, or assessment of student performance and 
degree of implementation as measured against 
benchmarks provided by the developer. 

Expeditionary Learning was established in 1992 
by Outward Bound LFSA. The approach is one 
of several sponsored by New American Schools, 
a national initiative to develop replicable school- 
wide reform programs. Sixty-five schools in 13 
states currently use the approach, which was de- 
signed for grades K-12. 
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EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Despite the fact 
that this is a relatively new approach, Expedition- 
ary Learning already has amassed a promising 
research base on student achievement effects. 
Three studies, one of which was conducted by 
an independent researcher, were reviewed. All 
three were sufficiently rigorous to report their 
findings here. 

Six studies, conducted by independent research- 
ers, evaluate implementation of the Expedition- 
ary Learning schools sponsored by New Ameri- 
can Schools. These studies provide information 
about which elements of the approach were easier 
or harder to implement. 

Effects on Students, The research results indi- 
cate that Expeditionary Learning can help to im- 
prove student achievement. Students tend to per- 
form well compared to state and district averages 
on standardized tests, such as the Iowa Test of 
Basic Skills and the Georgia Curriculum-Based 
AssessmentTest. Positive results have been found 
across subjects (e.g., reading, writing, math, sci- 
ence, and social studies). 

One study found significant two-year gains in 
standardized test scores of students in grades five 
through eight in reading and mathematics. The 
other two studies found that students in Expedi- 
tionary Learning schools improved on standard- 
ized and state tests compared to district and state 
averages in reading, mathematics, science, and 
social studies. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Adminis- 
trative Support. Expeditionary Learning requires 
one major organizational change: a transforma- 
tion to shared decision making. The approach re- 
quires teachers, parents, and other community 
members to be involved in the school leadership 
and decision-making process. No major changes 
are required in staffing or administrative support. 



Curriculum and Instruction. Expeditionary 
Learning requires significant changes to instruc- 
tion. A defining component of the approach is 
that students engage in learning expeditions, ex- 
tended studies that focus on a single theme, while 
incorporating instruction in different subject ar- 
eas. Expeditions typically involve service and 
fieldwork and culminate in student presentations 
or performances to families and community 
members. 

Instructional staff are expected to align expedi- 
tion topics and goals with state and district stan- 
dards and curriculum guidelines. 

Supplies and Materials. Expeditionary Learn- 
ing does not require or provide specific instruc- 
tional materials. However, the developer pro- 
vides materials to help school staff implement 
the approach. Some of the materials address 
theoretical and philosophical topics; others pro- 
vide models and practical information for de- 
veloping expeditions. 

Scheduling and Grouping. Schools adopting 
Expeditionary Learning are asked to make sig- 
nificant changes to the daily schedule. First, 
schools eliminate the traditional 50-minute, 
single-subject period; instead, they devise a sched- 
ule that accommodates learning expeditions 
(which may average ten to 16 weeks). Second, 
schools rearrange the schedule to provide instruc- 
tional staff with weekly common planning time. 

Expeditionary Learning schools do not group 
students according to performance level; rather, 
the developer promotes heterogeneous grouping. 
For some learning expeditions, students from 
different grades are grouped together. Expedition- 
ary Learning schools assign instructional staff to 
the same group of students for at least two years, 
which, according to the developers, helps build 
trust and a sense of community among teachers 
and students. 

Monitoring of Student Progress and Perfor- 
mance. Expeditionary Learning attempts to use 
“real-world performance” as its primary assess- 
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ment measure (e.g., demonstrations or portfo- 
lios of student work). Instructional staff are en- 
couraged to reflect regularly on student progress, 
and also on what student achievement says about 
the instructional practices of the school. Students 
also are subject to the regular state and district 
standardized assessments. 

Expeditionary Learning schools are required to 
conduct an annual self-review that examines the 
link between school instructional activities and 
student performance, and measures school prac- 
tices against core practice benchmarks. 

Family and Community Involvement. Expedi- 
tionary Learning encourages parent and commu- 
nity involvement, especially in the learning ex- 
peditions. Community members and parents are 
encouraged to contribute their own expertise and 
talents and to attend student presentations at the 
end of each expedition. 

The developer also encourages schools to work 
with local community agencies and businesses to 
provide opportunities for student learning (e.g., 
internships). 



SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 



Professional Development and Technical Assis- 
tance. The developer considers professional de- 
velopment integral to successful implementation. 
Instructional staff and school leaders receive at 
least 1 5 days of technical assistance per year. First, 
Expeditionary Learning staff or experienced Ex- 
peditionary Learning instructors provide schools 
with on-site professional development. Activities 
include helping teachers develop learning expe- 
ditions, aligning the expeditions with state stan- 
dards, coaching teachers in the classroom, and 
providing assistance related to assessment. 



The developer requires school leaders to attend a 
two-day leadership institute, designed to help 
schools assess their readiness to implement Ex- 
peditionary Learning and to address issues of in- 
terest to school leaders. In addition, participants 



learn about modifying the school schedule, as- 
signing planning time for teachers, and group- 
ing students. 

Professional development designed for instruc- 
tional staff includes a five-day summer institute 
at the school that focuses on designing learning 
expeditions. In addition, faculty attend mid-year 
mini-institutes (lasting two to three days) during 
which they plan their expeditions for the spring 
semester. Throughout the school year, half-day 
and full-day workshops are provided on topics 
selected by school staff. 



The developer provides other national profes- 
sional development activities, to which schools 
are encouraged to send one-quarter to one-third 
of their faculty each year. First, the developer pro- 
vides week-long summits during the summer, 
designed to demonstrate exemplary learning ex- 
peditions, to provide immersion in specific con- 
tent areas, and to give staff an opportunity to 
work closely with Expeditionary Learning teach- 
ers from other schools. Instructional staff also can 
participate in Outward Bound courses for edu- 
cators. The developer offers several opportuni- 
ties for faculty and administrators to learn from 
and share with Expeditionary Learning partici- 
pants, including a national leadership conference, 
a national conference for teachers and adminis- 
trators, and visits to other Expeditionary Learn- 
ing schools. 



Implementation Requirements and Schools’ Ex- 
periences. The developer stipulates three require- 
ments for schools interested in adopting the ap- 
proach. First, the school must demonstrate a high 
level of support from faculty and administration. 
At least 80 percent of the faculty and all of the 
school leadership must endorse adoption of the 
design after it has been presented to and discussed 
by the full faculty. Second, the school must com- 
mit to providing 15 to 20 days of professional 
development time for each classroom instructor 
and to budgeting for at least three hours of com- 
mon team planning time per week. Third, schools 
should demonstrate that they have sufficient fi- 
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nancial resources to implement and sustain the 
program. 

Research on implementation of Expeditionary 
Learning has found that schools using the ap- 
proach share several implementation strengths. 
The training, from introduction of the approach 
to training all staff, is a strength; teachers felt 
confident and comfortable with the instructional 
strategies. Teachers worked well together in some 
schools, and parents became more involved. 

In the schools studied, it was found that some 
components of Expeditionary Learning were 
more difficult to implement than others. Al- 
though student portfolios were used, there was 
little evidence of teachers or students reflecting 
on content, and some inconsistency in evaluat- 
ing the portfolios. The involvement of instruc- 
tional staff in school governance was inconsis- 
tent across the Expeditionary Learning schools. 

One study confirmed that full implementation 
is possible after several years. In one site, learn- 
ing expeditions and portfolio-based assessment 
were common, teachers taught and planned 
collaboratively, students worked cooperatively on 
projects, the 45-minute class period was elimi- 
nated while students were on expeditions, and 
students were grouped heterogeneously in read- 
ing and math. Parents and community members 
were involved, serving on committees and attend- 
ing student exhibitions. 

The study found that strong implementation was 
supported by a clear understanding of the ap- 
proach before it was adopted, strong administra- 
tive support, and sufficient professional develop- 
ment time. Successful sites were found to be those 
already considered “alternative” before adopting 
the approach, and sites that had additional fund- 
ing, which allowed schools to offer professional 
development activities to more staff 

The service component was found to be more 
difficult to implement than others, because teach- 
ers reported that they did not have enough time 
for this piece. 



COSTS 

The first-year cost of adopting Expeditionary 
Learning is $8 1 ,000. This cost covers professional 
development, including the developers estimate 
for teacher release time; and materials. 

The cost of implementing Expeditionary Learn- 
ing varies with the size of the school and the num- 
ber of participating schools in the district. In the 
first year, a school with 25 faculty members and 
500 students would pay $53,750 ($2,150 per 
faculty member). Schools with more than 25 fac- 
ulty members would pay $53,750 for the first 25 
individuals, plus $1,150 for each additional per- 
son; for example, a school with 40 faculty mem- 
bers would pay $71,000 ($53,750 + $1,150 x 
15). A smaller school would subtract $1,150 from 
$53,750 for every faculty member fewer than 25; 
for example, a school with 15 faculty members 
would pay $42,250 ($53,750 - $1,150 x 10). 
These figures assume that there are three or four 
Expeditionary Learning schools in a district. 
Costs are higher with fewer schools, but exact 
figures were not available. 

The above fee includes at least 15 days per year 
of professional development for every faculty 
member, including full-faculty summer 
institutes and mid-year mini-sabbaticals, as well 
as professional development materials. The fee 
allows one-quarter of the faculty to attend 
Outward Bound courses or summits, and one- 
quarter to attend the national conference or 
seminars at demonstration sites. (The developer 
reports that additional faculty may attend at no 
additional cost, if space allows.) The fee also 
covers attendance of the principal and one mem- 
ber of the school leadership team at the annual 
leadership conference, as well as at least 30 days 
of technical assistance, at least 20 of which are 
provided on-site. Travel costs, release time, and 
other related expenses for all events above are 
not included. 

In the second year, the costs are estimated to be 
the same as the first year. According to the devel- 
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oper, if schools are making good progress in 
implementing the approach, the cost will decrease 
by 20 percent in the third year, another 20 per- 
cent in the fourth year, and another 20 percent 
in the fifth year. 

In addition to fees paid to the developer, the de- 
veloper estimates that schools will have to pay 
$1,000 to $1,200 per faculty member per year 
for travel, stipends for teachers taking courses, 
substitutes, and expedition costs. 



CONTACT INFORMATION 

Ms. Meg Campbell 

Expeditionary Learning Outward Bound 

122 Mt. Auburn Street 

Cambridge, MA 02138 

Phone: 617-576-1260 

Fax: 617-576-1340 

E-mail: meg@elob.org 

Web site: www.elob.org 

Mr. Greg Farrell 
Outward Bound USA 
100 Mystery Point Road 
Garrison, NY 10524 
Phone: 914-424-4000 
Fax: 914-424-4280 
E-mail: farrell@elob.org 
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The Foxfire Fund 



Evidence of positive effects on student achievement 


? 


Year introduced in schools 


1966 


Number of schools 


Not available 


Support developer provides schools 


3 


First-year costs 




with new staff 


$65,000 


with current staff reassigned 


No change 



• = Strong 3 = Promising Q = Marginal O = Mixed, Weak ?= No Research 



OVERVIEW 

The Foxfire Fund promotes the idea of active, 
learner-centered, community-focused educa- 
tion. The Foxfire “Core Practices” are expected 
to guide instructional methods, materials, and 
strategies. The developer encourages teachers to 
involve students in selecting, planning, and di- 
recting classroom activities. Teachers also are 
encouraged to connect classroom activities to 
the community — that is, to create what the de- 
veloper refers to as “the community as a learn- 
ing laboratory.” 

As a reform approach. Foxfire has traditionally 
worked with individual teachers, although it has 
recently been adapted to work as a schoolwide 
improvement model. Schools interested in de- 
veloping a schoolwide “Foxfire-Affiliated Alli- 
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ance” receive guidelines and other materials to 
assist with implementation. 

The Foxfire approach was developed in 1966 
by Eliot Wigginton, a high school English 
teacher who was seeking a vehicle to teach basic 
high school English skills. He devised a project, 
grounded in the theories of John Dewey and 
research on effective instruction, in which stu- 
dents interviewed community members who 
had special expertise or historical perspectives 
and wrote about what they learned. This project 
led to the publication of the Foxfire Magazine 
and a series of books on Appalachian life and 
folkways. The Foxfire approach evolved as other 
teachers attempted to replicate the project’s suc- 
cess, and has since expanded to be more com- 
prehensive and reach across grade levels and 
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course content. Currently, teachers in 38 states 
use the approach. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. No rigorous stud- 
ies on Foxfires effects on student achievement 
could be found. However, some student test data 
are collected and made publicly available by the 
developer. Three studies analyzing implementa- 
tion of Foxfire were reviewed. 

Effects on Students. No studies analyze the ef- 
fects of Foxfire on student achievement. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Foxfire does not require any 
changes in organization or staffing. Teachers can 
implement the approach on their own; however, 
the developer reports that administrative support 
is required for successful implementation. 

Curriculum and Instruction. The developer ad- 
vocates that instructional staff encourage students 
to play an active role in determining how to reach 
state and local standards. In addition, teachers 
are encouraged to guide students to link learn- 
ing to the community. 

Eleven Core Practices provide a framework for 
thinking about and assessing classroom practice: 

1) classroom work is infused with student 
choice and design; 

2) the teacher’s role is collaborator and 
facilitator; 

3) the academic integrity of the work is clear; 

4) the work is characterized by active learning; 

5) emphasis is placed on small -group work, 
peer teaching, and inclusion of all students; 

6) connections between class work and the 
community are clear; 



7) there is an audience beyond the teacher for 
student work; 

8) new learning includes previously acquired 
skills and understandings; 

9) learning experiences encourage creative 
thought and action; 

10) reflection occurs at key points throughout 
the work; and 

11) the work includes rigorous, ongoing 
assessment. 

Supplies and Materials. The developer does not 
provide or require specific supplies or materi- 
als, but reports that activities sometimes require 
materials beyond those used in traditional class- 
rooms. In this case, the developer encourages 
teachers to work with students to identify 
means to raise the funds to acquire the neces- 
sary materials. 

Scheduling and Grouping. Foxfire does not re- 
quire any specific scheduling arrangements. The 
developer encourages a variety of grouping strat- 
egies including individual, whole-class, and small- 
group work. According to the developer, much 
of the work ends up being performed in small 
groups. 

Monitoring Student Progress and Performance. 
The developer believes that monitoring of stu- 
dent progress is essential. Teachers are encour- 
aged to involve students in developing perfor- 
mance evaluations to ensure that their activities 
are meeting curriculum expectations. The devel- 
oper encourages alternative assessment of skills 
and knowledge in addition to standardized 
achievement tests. 

Family and Community Involvement. The 
Foxfire approach emphasizes the importance of 
connecting the classroom curriculum to the com- 
munity. Teachers are encouraged to help students 
identify ways they can learn required skills and 
content by seeking information and resources 
from within the community. 
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SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical As- 
sistance. The Foxfire Fund offers four types of 
professional development. First, the developer 
produces materials to help instructional staff ex- 
plain their practice to parents and colleagues and 
expand the effectiveness of Foxfire through re- 
flective planning activities. Second, Foxfire pro- 
vides ongoing support, including membership 
in national and regional networks, participation 
in informal affiliations, national conferences and 
meetings, and on-line connections among teach- 
ers with similar interests. Third, Foxfire pro- 
duces publications for instructional staff, includ- 
ing: The Active Learner: A Foxfire Journal for 
Teachers; a quarterly newsletter; the Foxfire Pa- 
pers (brief position papers designed to clarify 
specific issues); the Teacher Reader (collections 
of current research, theory, and practice regard- 
ing each core practice); and The Core Practices: 
Discussions and Implications. 

Finally, the developer offers a series of staff train- 
ing programs. The first is an introductory pre- 
sentation called “Taste of Foxfire.” This session, 
which lasts from two hours to two days, is re- 
quired for schools interested in implementing the 
schoolwide approach. 

Two courses (“Level One” and “Level Two”) com- 
pose the bulk of the training. Level One, which 
consists of 50 hours of training plus follow-up 
activities, is offered in a variety of sites around 
the country (through universities, regional net- 
works, in collaboration with other school reform 
groups, and through school districts or individual 
schools). Its primary goal is to provide teachers 
with the opportunity to rethink their existing 
perceptions of the relationships among teachers, 
students, and curriculum, while they plan for 
change in their classrooms. Follow-up activities, 
tailored to instructors’ needs, include training in 
skills required to implement the approach (e.g., 
assessing student learning) and collective resolu- 
tion of implementation challenges. Level Two is 



typically taken at the conclusion of the first year 
of implementation, and also is held at a variety 
of sites around the country. The 25-hour course 
focuses on deepening and extending participants’ 
ability to implement Foxfire. 

The developer also offers three-day summer semi- 
nars, held at the Foxfire Center in Mountain City, 
Georgia, that focus on topics related to the Core 
Practices. Finally, special programs may be de- 
veloped to support the work of teams of teachers 
within a school. Often, these programs are de- 
signed to support the development of integrated 
curricula that use the community as a learning 
laboratory. The length and content of these pro- 
grams are determined collaboratively with school 
staff. 

Implementation Requirements and Schools’ Ex- 
periences. Foxfire’s work within a school, whether 
with a team or the entire staff, requires adminis- 
trator support. Therefore, administrator partici- 
pation in training activities is encouraged. Long- 
term work may be done with teams or clusters, 
based on the needs identified by participants and 
the contract negotiated with the school. It is not 
required that schools become affiliated with 
Foxfire in order to purchase services. However, a 
school interested in becoming part of the Foxfire- 
Affiliated Alliance must meet a number of con- 
ditions: 

1) The school has a clearly-articulated mission 
and philosophy that is compatible with the 
Core Practices. 

2) Teachers within the school use the approach 
by choice, rather than mandate. 

3) At least 60 percent of faculty members have 
completed the Level One course and cur- 
rently use the approach. 

4) The school administration supports becom- 
ing a member of the Alliance. 

5) The school demonstrates respect for diver- 
sity of approaches and strategies. 
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6) The school staff engages in ongoing reflec- 
tion and evaluation of the schools use of the 
Core Practices. 

7) Teaching and learning opportunities and ex- 
periences grow out of the stated philosophi- 
cal foundation. 

8) The Alliance has the capacity to arrange Level 
One training for new teachers. 

If the whole-school approach is not followed, 
implementation of Foxfire is left to the initiative 
of individual teachers. While training and sup- 
port are available from The Foxfire Fund, teach- 
ers have to implement the approach by them- 
selves in their own classrooms. 

Three implementation studies of Foxfire were 
reviewed. These studies focus on barriers to imple- 
menting Foxfire in order to resolve such issues, 
and therefore highlight problems rather than suc- 
cesses. One found that, of 12 teachers who had 
recently completed the Level One course, all but 
one had incorporated strategies learned in the 
course into their classes. This study found that 
one of the most difficult elements to implement 
was designing activities to provide more student 
decision making or choices. 

The studies identified several conditions that sup- 
ported the implementation of Foxfire, including: 
having a supportive principal and superintendent; 
establishing professional development follow-up; 
instituting a flexible district curriculum; and hav- 
ing other Foxfire teachers in the classroom. Barri- 
ers to implementation also were identified, includ- 
ing: insufficient time to implement the approach; 
lack of autonomy in the classroom due to state or 
local mandates; resistance toward student empow- 
erment; teacher evaluation systems that reward 
teachers for keeping students ‘on task”; and an 
open school design that inhibits group work. 

COSTS 

The first-year cost for implementing Foxfire is 
$65,000. This includes average costs for the “Taste 
of Foxfire” presentation. Level One training, teacher 



release time (approximately 7.5 days) for profes- 
sional development, and Foxfire membership. 

Professional development represents the bulk of the 
cost of implementing Foxfire. The introductory 
“Taste of Foxfire” presentation costs between $50 
and $600 (excluding travel), depending on the 
length and the content of the workshop. The Level 
One course costs $350 to $650 per teacher, depend- 
ing on whether graduate college credit is awarded. 
The developer estimates that Level One training 
for an entire school — including costs of training, 
materials, and follow-up visits — ^will cost between 
$12,000 and $14,000 foraschool of 500 students. 
The Level Two course costs $7,000 to $9,000 for a 
whole school ($350 to $450 per teacher). 

Summer seminars range in price based on the 
number of days and materials required. For three- 
day courses with required materials, including 
housing at the Foxfire Center and two meals each 
day, participants would expect to pay $300. The 
content and fees for special programs designed 
to meet the needs of individual schools or teams 
of teachers are negotiated on an individual basis. 

National membership is $40 per year and includes 
a subscription to The Active Learner. (An annual 
journal subscription alone would cost $20.) Re- 
gional networks set their own membership fees, 
ranging from $5 to $45 per year. Publications 
and materials cost $25 for the Teacher Reader 
ries; support materials begin at $6.50 for reflec- 
tive planning outlines. 



CONTACT INFORMATION 

Ms. Christy Stevens 
The Foxfire Fund 
P O- Box 54 1 

Mountain City, GA 30562-0541 
Phone: 706-746-5828 
Fax: 706-746-5829 

E-mail: foxfire@foxfire.org 
Website: http://www.foxfire.org 
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High Schools That Work 



Evidence of positive effects on student achievement 


• 


Year introduced in schools 


1987 


Number of schools 


860 


Support developer provides schools 


• 


First-year costs 




with new staff 


$48,000 


with current staff reassigned 


No change 


® = Strong = Promising (i = Marginal O = 


Mixed, Weak ?= No Research 



OVERVIEW 

High Schools That Work provides a set of strate- 
gies designed to raise the academic achievement 
of career-bound high school students by com- 
bining the content of traditional college prepa- 
ratory studies (e.g., English, mathematics, sci- 
ence) with vocational studies. The developers 
specify the following key practices: 

• high expectations for student learning; 

• rigorous vocational courses; 

• more required academic courses; 

• learning in work environments; 

• collaboration among academic and vocational 
teachers; 



• an individualized advising system; 

• active engagement of students’ interest; 

• extra help outside of school and in the sum- 
mer; and 

• use of assessment and evaluation data to im- 
prove students’ learning. 

High Schools That Work is an initiative of the 
Southern Regional Education Board. The ap- 
proach has grown from a pilot program, imple- 
mented in 28 schools in 13 states in 1987, to 
860 sites in 22 states as of July 1998. The devel- 
opers plan to add 100 to 150 sites in the 1998- 
99 school year, and a similar number in 1999- 
2000 . 
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EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Overall, the re- 
search base on High Schools That Work is strong. 
Of the ten studies that report results on student 
achievement, four use sufficiently rigorous meth- 
odologies to report their findings here. The remain- 
ing studies focus primarily on implementation of 
the approach. Effects were studied in a large num- 
ber of schools, including original and replication 
sites, and urban and rural schools. The number 
and variety of the schools that have been studied 
contributes to the strength of the research base. 

A weakness of the research base is that few stud- 
ies use matched control groups. Much of the re- 
search compares schools that are new to High 
Schools That Work with schools that have been 
using the approach for some time. Other studies 
focus on case studies of successful schools, those 
in which students made especially strong progress. 
This methodology identifies more-successful and 
less-successful High Schools That Work schools; 
it does not provide evidence that the approach 
itself improves learning. Another problem is that 
there are few independent evaluations. All four 
of the rigorous studies reported here were con- 
ducted by or for the developers. 

Effects on Students. The available research 
shows positive effects on students. Studies in- 
dicate that High Schools That Work improves 
student performance on the National Assess- 
ment of Educational Progress (NAEP) and a 
test developed by High Schools That Work 
based on NAEP. Studies of effects also show 
that High Schools That Work students, includ- 
ing vocational students, take more academic 
courses (especially mathematics and science) 
than students at the same schools did before 
the approach was implemented. However, not 
all students take the number of academic 
courses required in the approach (described 
under Curriculum and Instruction) . 

The positive results seem stable across a variety 
of schools. Specifically, effects seem consistent 



across urban and rural schools and seem to per- 
sist for schools that were not in the original set of 
pilot schools. This suggests that High Schools 
That Work has positive effects, and those effects 
can be replicated. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. The developer requires schools 
to establish a school advisory council composed 
of students, parents, teachers, community mem- 
bers, and business leaders to coordinate imple- 
mentation of High Schools That Work. The 
school principal and a designated central-office 
administrator play a major role in implementa- 
tion, either serving on or chairing the school ad- 
visory council. In addition, many schools estab- 
lish vocation-based advisory councils composed 
mainly of local business members. 

.Curriculum and Instruction. High Schools 
That Work encourages substantial changes in 
the curriculum to provide a more challenging 
high school experience for students who are 
not planning to attend college. These changes 
include: 

• setting high standards based on the National 
Assessment of Educational Progress; 

• enrolling career-bound students in college- 
bound academic courses; and 

• dropping basic courses (e.g., “Math 101”) 
from the curriculum. 

In a High Schools That Work school, students 
are required to take at least four college prepa- 
ratory English credit courses; at least three cred- 
its each in math and science (junior and se- 
nior year); at least three social studies credits; 
at least four credits in a broad field of voca- 
tional study; and at least two credits in a re- 
lated academic or technical field, including one 
in computer science. 

Supplies and Materials. The developer recom- 
mends materials for students that it considers 
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more challenging than those typically used in 
vocational education classes (e.g., replacing the 
English book used in vocational education with 
the English book used by the college-bound stu- 
dents in the school). The developer does not 
provide or recommend any specific curriculum 
materials. 

Scheduling and Grouping. The developer re- 
quires schools to reorganize the daily schedule 
into blocks of time that are longer than the tra- 
ditional period (e.g., 90 as opposed to 60 min- 
utes). Each block of time is devoted to a core 
academic course (e.g., English, mathematics, 
science). 

Monitoring Student Progress and Performance. 
In addition to any mandated state or district as- 
sessments, students in High Schools That Work 
schools are required to participate in an annual 
math, science, and reading assessment related to 
NAEP. 

The developer also recommends that students 
be assessed daily through their work as they solve 
problems together, keep logs and journals, and 
complete other exercises that monitor growth 
in their ability to understand and use 
information. 

Also, with the help of the developer, schools must 
identify students who need extra help and time 
to meet higher standards. The school is respon- 
sible for the cost and time of any extra assistance 
(e.g., tutorial sessions) needed to help students 
meet the standards. 

Family and Community Involvement. Students, 
parents, teachers, community members, and busi- 
ness leaders serve on a school advisory council. 
In addition, local business members serve on 
many of the individual vocation-based advisory 
councils at separate school sites. The purpose of 
both the school advisory council and the voca- 
tion-based advisory council is to provide feed- 
back to the school on the program and, in the 
case of the school advisory council, to coordi- 
nate program implementation. 



SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. In the first year of implementation, the 
developer provides a required two-day workshop 
(at a central location or at the school) where staff, 
parents, and members of the community develop 
a school action plan. The action plan identifies 
issues of importance to the . school and sets a 
schedule for resolving these issues. Developer staff 
members make at least two follow-up visits to 
help schools implement their action plans. In 
addition, required professional development in 
the first year includes a three-day training ses- 
sion in leadership, and a three-day retreat for 
school leaders. 

In addition to these required activities, the de- 
veloper provides customized professional devel- 
opment. High Schools That Work staff and 
school staff work together to conduct an assess- 
ment of students’ academic needs using a High 
Schools That Work assessment package created 
by the Educational Testing Service. Every year, 
the developer provides two to four workshops to 
help schools address student needs that have been 
identified. Workshop topics might include select- 
ing indicators of progress and performance, learn- 
ing through projects, using data to update the 
site action plan, or developing syllabi, among 
others. 

The developer recommends that school staff read 
the following materials in the first year to help 
implementation: At Your FingertipSy a 250-page 
workbook containing a six-step approach to 
monitoring school improvement; the Practi- 
tioner's Guide to Getting to Work, a package of 
strategies, activities, and case studies for use by 
teachers and administrators; Making High Schools 
Work; and Teaching for Understanding Staff de- 
velopment guides and research reports also are 
recommended reading. 

In the summer after the first year of implemen- 
tation, a team from each High Schools That Work 
school is required to attend a three-day summer 
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institute. The institute, held immediately before 
or after an optional four-day High Schools That 
Work Conference, focuses on topics such as 
changing the organization of the school, plan- 
ning staff development, and finding resources. 

In the second year of implementation, the devel- 
oper visits the school two to five times to provide 
technical assistance; after these visits, the devel- 
oper gives the school written reports recommend- 
ing next steps in implementation. High Schools 
That Work expects school faculty to modify and 
improve the schools action plans for the follow- 
ing year, using results from student assessments 
in the first year and the At Your Fingertips work- 
book. Further, the developer recommends that 
staff review research briefs based on national data 
from the 1996 High Schools That Work assess- 
ment and the Practitioners Guide to Getting to 
Work, a guide developed by the program. Rec- 
ommended sections include integrating voca- 
tional and academic curricula, learning experi- 
ences, and assessment. Teams from High Schools 
That Work schools are required to attend the 
three-day summer institute after the second year 
of implementation. 

For the third year, the developer recommends 
guides on topics such as designing vocational 
courses and using new classroom methods as well 
as the Practitioners Guide to Getting to Work. The 
section on assessment is particularly recommended. 

Implementation Requirements and Schools’ 
Experiences. High Schools That Work is de- 
signed to be implemented over a three-year pe- 
riod. However, according to the developer, full 
implementation often takes slightly longer. Be- 
fore the start of implementation, the developer 
requires schools to commit $15,000 to $20,000 
annually for staff development, curriculum de- 
velopment, planning time to develop new les- 
sons, stipends for professional development, and 
other local costs. In addition, schools are re- 
quired to demonstrate support from the district 
office, school leaders, and the school board. An 
80 percent vote of approval by faculty is re- 



quired, as is participation in the annual High 
Schools That Work assessment. 

According to the developer, reviews conducted 
by High Schools That Work staff are used to de- 
termine how the key practices are being imple- 
mented, to identify major concerns, and to rec- 
ommend solutions. In addition, toward the end 
of implementation, the developer helps schools 
conduct a survey of students’ perceptions of their 
high school experience and teachers’ expectations. 

According to one implementation study, many, 
but not all, students in High Schools That Work 
take a challenging academic course load and/or 
complete a major. This study suggests actions to 
help high schools integrate challenging academ- 
ics into vocational studies, including: 

• Schools require students to choose a major 
(academic or career), or develop an academy 
within the school that joins an emphasis on 
academics with a career focus. 

• Teachers use instructional strategies that fo- 
cus on students, such as student projects or 
emphasis on writing, as an essential part of 
all instruction. 

• Schools provide extra support (such as reme- 
dial courses or tutoring) to career-bound stu- 
dents who are taking challenging academic 
courses. 

• Schools involve instructional staff in making 
decisions for the school, such as committees 
of teachers and administrators to hire new 
staff, set budgets, and establish the curricula. 

• Schools connect with businesses in the com- 
munity to help students learn about careers 
or develop skills, or to provide financial sup- 
port to the school. 

• Schools use information such as test scores 
and surveys to identify students’ strengths and 
weaknesses, in order to improve instruction. 

• District staff provides schools with needed 
support, such as teacher release time for pro- 
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fessional development, and helps to bring 
together school stafif, parents, and business 
and community leaders. 

• Schools build connections with middle and 
postsecondary schools, to help students make 
the transition from one stage of learning to 
the next. 

COSTS 

The first-year cost of adopting this approach is 
$48,000. This includes the average cost for pro- 
fessional development, technical assistance, as- 
sessment, and materials. It also includes an aver- 
age amount the developer estimates that schools 
should set aside for expenses, such as teacher re- 
lease time. 

Developer fees for High Schools That Work are 
based on a three-year implementation. The costs 
for a district or school interested in the approach 
are as follows: 

• Year 1: $25,000-$35,000. This includes the 
costs of the workshop in which the school 
action plan is developed; technical assistance 
(including guidance for instructional staff in 
developing curricula); professional develop- 
ment; the High Schools That Work assess- 
ment package; team registration at the na- 
tional summer conference; and materials. 



• Year 2: $25,000-$35,000. This includes a 
technical assistance visit by High Schools 
That Work staff and follow-up technical as- 
sistance; staff development; assistance with 
curriculum development; the High Schools 
That Work assessment package (optional this 
year); and team conference registration. 

• Year 3: $25,000-$35,000. This includes ad- 
vanced staff development; follow-up techni- 
cal assistance (including guidance in updat- 
ing the site action plan); team conference reg- 
istration; the High Schools That Work as- 
sessment package; and an evaluation of the 
effects of High Schools That Work. 

In addition, sites are required to provide $15,000 
to $20,000 annually for staff development, cur- 
riculum development, planning time, stipends, 
and other local costs. 



CONTACT INFORMATION 

Dr. Gene Bottoms, Senior Vice President 
Southern Regional Education Board 
592 Tenth Street, N.W 
Atlanta, GA 30318-5790 
Phone: 404-875-9211 
Fax: 404-872-1477 
E-mail: gene.bottoms@sreb.org 
Website: http://www.sreb.org 
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High/Scope K-3 Model 



Evidence of positive effects on student achievement 




Year introduced in schools 


1967 


Number of schools 


27 


Support developer provides schools 


• 


First-year costs 




with new staff 


$130,000 


with current staff reassigned 


No change 


® = Strong = Promising (i = Marginal O = 


Mixed, Weak ?= No Research 



OVERVIEW 

The High/Scope K-3 model is based on the be- 
lief that children should be active participants in 
their ovv^n education and that they learn best from 
hands-on experiences. A primary goal is to im- 
prove childrens problem-solving and indepen- 
dent thinking skills. Teachers are encouraged to 
guide learning by observing, supporting, and ex- 
tending activities initiated by students, although 
more structured learning experiences also may be 
provided. 

The first — and best-know^n — High/Scope ap- 
proach, the High/Scope Perry Preschool Model, 
yvas developed in 1962 to se^e disadvantaged 
pre-K students. The approach has since been 
adopted by individual schools and teachers to 
serve a wide range of students and communities. 



The K-3 model was established in 1967. (The 
developer is in the process of expanding the model 
to upper elementary and middle school students.) 
In its first year, High/Scope K-3 was implemented 
in ten schools in six states. As of summer 1998, 
the developer estimated that High/Scope staff 
provided a full range of service to 27 schools and 
partial services for more than 500 schools. In 
addition, several thousand schools use the High/ 
Scope materials. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Research on the 
effects of the High/Scope K-3 approach is mar- 
ginal. Only one study examined the approach’s 
effects on student achievement. That study was 
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sufficiently rigorous to report the results here. In 
addition, two implementation studies were re- 
viewed. To date, most studies of High/Scope have 
focused on the preschool model and were not 
considered for this report. 

Effects on Students. The one rigorous study of 
this approach shows positive effects on student 
achievement. Test scores of High/Scope students 
were compared to scores of other students in the 
same school and to students at a similar, non- 
High/Scope school. High/Scope students scored 
significantly higher on various standardized tests 
(e.g.. Comprehensive Test of Basic Skills, Iowa 
Test of Basic Skills, California Achievement Test, 
Stanford Achievement Test) than their 
counterparts. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Ad- 
ministrative Support. The High/Scope K-3 
model requires little organizational change within 
schools, nor does it require schools to hire addi- 
tional staff. The developer recommends two 
adults for each class — a teacher and a teaching 
assistant — but this is not required. There are no 
specific requirements for the number of children 
per class or the ratio of students to teachers. 

Curriculum and Instruction. Curriculum and 
instruction are based on four principles. First, the 
High/Scope approach believes that, from birth 
to adulthood, individuals develop awareness and 
understanding through active engagement with 
people, events, materials, and ideas. The devel- 
opers call this process active learning. Second, 
individuals learn best when they are encouraged 
to plan, carry out, and reflect on activities. Third, 
intellectual development occurs in a predictable 
order, and many kinds of learning experiences 
contribute to the learners intellectual, social, 
emotional, and physical development. Fourth, 
consistent support for children in making their 
own decisions helps them use more self-control 
and feel more competent and responsible. 



These principles are supposed to be supported 
by a curriculum structured around a “plan-do- 
review” period and “key experience workshops.” 
In the plan-do-review process, children choose, 
organize, and evaluate their own activities. Key 
experience workshops are small-group classroom 
activities in language, mathematics, science, 
movement, and music. 

High/Scope classrooms should have a number 
of “activity centers” where students can work to- 
gether in small groups. These activity areas should 
have materials that are accessible to children, so 
that students can use them independently dur- 
ing plan-do-review. 

For reading instruction, the developer encour- 
ages a blend of phonics and whole language ap- 
proaches and emphasizes writing. 

Supplies and Materials. The High/Scope K-3 
model is designed to be used with commercially 
developed materials or materials already used at 
the school, not materials provided by the devel- 
oper. Although school staff are not required to 
do so, the developer notes that teachers often cre- 
ate their own materials. Since 1986, the devel- 
oper also has supported the use of technology 
with the approach. 

Guides developed by High/Scope provide de- 
tailed information on implementing the K-3 ap- 
proach. Specific guides and materials that are 
available include: 

• curriculum guides in movement, music, lan- 
guage and literacy, learning environment, 
mathematics, and science; 

• videotapes on active learning, classroom 
environment, language and literacy, and 
mathematics; 

• movement and music materials (e.g.. Teach- 
ing Movement and Dance, Movement Plus Mu- 
sic, Rhythmically Walking', and 

• related High/Scope press publications (e.g., 
A School Administrator s Guide to Early Child- 
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hood Programs, High/Scope Buyers Guide to 
Childreris Software). 

Scheduling and Grouping. The High/Scope K- 
3 model requires grouping students three dif- 
ferent ways during a typical school day: as an 
entire class, in small groups of four to six stu- 
dents, and individually for plan-do-review time. 
The developer will provide interested schools 
with a “typical schedule” for both a half-day and 
full-day kindergarten, and for grades one to 
three. 

Monitoring Student Progress and Performance. 
High/Scope instructional staff are encouraged to 
monitor children on an ongoing basis to ensure 
that activities and instruction are tailored to in- 
dividual needs. Teachers are encouraged to record 
their observations of student activities and 
progress, but specific forms or types of assess- 
ments are not required. 

Family and Community Involvement. High/ 
Scope recommends field trips to provide children 
with active experiences relating to their lives out- 
side of school. While High/Scope does not re- 
quire specific involvement with families or the 
community, it encourages staff to use commu- 
nity resources and involve parents in their 
childrens learning. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. Schools may choose to implement High/ 
Scope partially, with limited guidance from the 
developer, or as a schoolwide model with a full 
range of support including direct guidance and- 
ongoing professional development. Among the 
hundreds of schools currently doing something 
with the approach, 27 have contracted with High/ 
Scope for full services. 

For schools contracting for full support. High/ 
Scope staff present a week-long training session 
at the school during the summer, at which 



school staff learn the basic elements of the ap- 
proach and develop plans to implement it in 
their own classrooms. 

During the first year of implementation. High/ 
Scope staff provide four additional training vis- 
its. Topics include such areas as the plan-do-re- 
view process; methods of evaluation; guides to 
educational software; and the use of technology 
and activities in specific subject areas, such as lan- 
guage arts, math, science, movement, and mu- 
sic. During years two and three, High/Scope staff 
visit schools five times a year to conduct one-day 
workshops, observe classrooms, and provide feed- 
back to staff 

High/Scope schools have opportunities to learn 
from each other through an annual High/Scope 
Registry Conference each spring, regional con- 
ferences, the High/Scope newsletter called Re^ 
source, and the High/Scope Web site. 

Implementation Requirements and Schools’ Ex- 
periences. The developer recommends that 
schools interested in a schoolwide implementa- 
tion of the High/Scope K-3 approach garner sup- 
port by involving staff and parents in a one-week, 
introductory training. A formal vote by staff is 
not required. Space in classrooms also must be 
arranged for activity centers, which may require 
the development or purchase of new materials. 

After visiting the school to provide guidance and 
professional development, a High/Scope trainer 
uses a High/Scope Elementary Program Imple- 
mentation Profile to report on implementation. 
The Profile uses a checklist to measure changes 
in classroom environment, instructional meth- 
ods, and adult-child interactions. Both the school 
and High/Scope staff receive a copy of the report 
to help them make improvements in the program. 

According to the limited implementation research 
available, High/Scope can be implemented suc- 
cessfully when the approach receives adequate 
support. One implementation study found that 
training was considered extremely useful; how- 
ever, it was noted that the distance between the 
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implementing school and the High/Scope orga- 
nization, located in Michigan, was a barrier to 
communication. The developer suggests that 
ongoing professional development, local admin- 
istrative support, and required supplies, materi- 
als, and equipment can contribute to successful 
implementation. 

COSTS 

The first-year cost of implementing the approach 
in a school of 25 K-3 teachers is $130,000. This 
is based on an estimate of one year of professional 
development, including estimated teacher release 
time; materials; and consultant travel expenses. 
Few elementary schools have 25 K-3 teachers, so 
costs for the typical school would be lower. For a 
school of eight K-3 teachers, first-year costs would 
be approximately $42,000. 

Costs the school pays the developer are negoti- 
ated on an individual basis and are influenced by 
the number of classrooms in the school and travel 
costs for High/Scope trainers. A typical cost for 
a three-year contract with High/Scope (for a 
school with eight K-3 classrooms and an average 
class size of 25) is as follows: 

• consulting fee paid to High/Scope for 1 5 site 
visits: $35,700; 



• curriculum guides and recordings for eight 
classrooms: $4,000 (first year only); 

• workshop materials: $750; 

• registration for six staff members to attend 
High/Scope Registry Conference for three 
years: $1,800; and 

• Estimated travel, food, and lodging for con- 
sultant: $14,900. 

Costs are estimated to be stable across the time 
period because services are consistent through- 
out the three-year contract. In addition to these 
costs, schools pay travel, release time, and other 
expenses for teachers to attend conferences and 
workshops. 

CONTACT INFORMATION 

The High/Scope Educational Research 
Foundation 

600 North River Street 

Ypsilanti, MI 48198 

Phone: 734-485-2000 

Fax: 734-485-0704 

E-mail: info@highscope.org 

Web site: http://www.highscope.org 
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League of Professional 
Schools 



Evidence of positive effects on student achievement (J 


Year introduced in schools 


1989 


Number of schools 


158 


Support developer provides schools 


3 


First-year costs 




with new staff 


$13,000 


with current staff reassigned 


No change 


® = Strong = Promising (J = Marginal 


0 = Mixed, Weak ?= No Research 


OVERVIEW 


framework. First, a covenant of teaching and learn- 



The League of Professional Schools is a network 
that intends to ‘‘democratize” education by en- 
couraging school staff, students, parents, and 
community members to play an active role in 
making the decisions that affect teaching and 
learning. A central premise of the League is that 
people who are actually in the school know and 
care most about the students, programs, and 
future possibilities for improvement, and there- 
fore must be included in decision making. De- 
velopers believe that this “democratization” pro- 
cess will improve student learning and, by ex- 
ample, teach students the ideals of a democratic 
society. 

League schools work, to achieve schoolwide in- 
structional improvement using a three-part 



ing describes what people associated with the 
school want students to know and be able to do, 
specifying appropriate instructional practices and 
assessments of student mastery. The covenant 
serves as the guiding vision of the schools effort 
to provide the best possible educational experi- 
ences to students. 

Second, there is a commitment to shared gover- 
nance, whereby all staff are promised an equal 
voice in “bringing their covenant of teaching and 
learning to life.” 

The final part of the framework is an action re- 
search process though which the staff studies the 
effects of educational decisions on students. In 
line with the covenant of teaching and learning, 
schools are supposed to determine the issues that 
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they wish to examine, collect and study data, and 
use the results of this research in making deci- 
sions to improve the school. 

The League was founded in 1989 by Carl 
Glickman of the University of Georgia. The origi- 
nal Georgia League has over 100 schools. There 
are also League-affiliated clusters in Nevada (17 
schools) and Washington (4l schools). Although 
the three state-level clusters are run independently 
from the developer, they all follow the same guid- 
ing principles. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Overall, research 
on the League’s effects on student achievement is 
marginal. Specifically, three studies examined the 
approach’s effects on student achievement; two 
of these three studies were considered sufficiently 
rigorous to report here. 

Five studies that focused on implementation is- 
sues also were reviewed. All of the research ex- 
amined schools in the Georgia League. 

Effects on Students. One study, conducted by 
the developer, found that dropout rates in one 
League school fell from 12 percent to 9 percent 
to 6 percent over a three-year period. A second 
study, conducted by an independent researcher, 
compared student outcomes in 45 League schools 
to comparison schools. It found slight non- 
significant differences favoring League schools on 
assessments of academic performance. However, 
there is evidence that academic performance was 
higher in schools where the League approach was 
well implemented. Both studies were of elemen- 
tary schools in Georgia. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. The League attempts to 
change how schools are run by involving staff, 
administrators, parents, students, and commu- 



nity members in making decisions regarding 
instruction and schoolwide strategies. There- 
fore, the League may require significant changes 
in school governance. Schools establish Lead- 
ership Teams to guide the process. Leadership 
Team members can be appointed by the princi- 
pal or can volunteer; however, electing mem- 
bers is the preferred method. Leadership Teams 
bring issues to the attention of the entire staff, 
students, and the educational community, who 
then have a voice in making decisions for the 
school. The developer considers support from 
principals and other school administrators to 
be crucial to success. 

In addition to a new role in governance, staff 
members assume responsibility for conducting 
action research. Faculty are responsible for de- 
termining the research design and conducting the 
research. Typically, data are collected through 
surveys (for example, on student or teacher atti- 
tudes about a subject area, school climate, etc.), 
from files, and from standardized tests. Accord- 
ing to the developer, the League is now focusing 
more on teaching and learning issues and less on 
issues dealing with governance. League meetings, 
on-site visits, newsletters, summer institutes, and 
a new consortium of League educators are geared 
to reflect an emphasis on classroom practices and 
student demonstrations of learning. 

Curriculum and Instruction. The League does 
not provide or require specific curriculum or in- 
struction. However, the League works with and 
encourages participating schools to make cur- 
ricular and instructional changes that are con- 
sistent with the school’s covenant of teaching 
and learning. 

Supplies and Materials. The League does not pro- 
vide or require specific materials or supplies. 

Scheduling and Grouping. There are no specific 
requirements for scheduling classes or school days, 
nor does the League provide guidelines for group- 
ing students in or across classes. However, accord- 
ing to the developer, the League’s democratic 
principles argue against tracking. 
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Monitoring of Student Progress and Perfor- 
mance. The League does not provide guidelines 
for monitoring student performance. However, 
the action research component requires schools 
to collect data; for some schools, this may require 
additions or adaptations to current methods of 
assessing student progress. 

Family and Community Involvement. Family 
and community involvement is an encouraged, 
but not required, component of the League ap- 
proach. The developers encourage schools to in- 
volve families and the community in writing their 
teaching and learning covenants, in making de- 
cisions related to fulfilling the covenant, and in 
the action research process. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. League schools have access to on-site tech- 
nical assistance and off-site conferences and insti- 
tutes. Teams of approximately six staff members, 
typically teachers and administrators, may partici- 
pate in three professional development conferences 
each year: one two-day conference in the fall, and 
two one-day conferences in the winter and the 
spring. Schools are required to send a team to the 
fall and winter conferences. The spring conference 
is considered optional. (However, schools that 
choose to send a team to the spring session do not 
have to pay an additional fee.) Conferences have 
breakout sessions, including sessions that address 
action research issues. 

The League also offers optional institutes during 
the school year and over the summer on topics 
such as team building, action research, grant writ- 
ing, and specific instructional innovations. The 
sessions are conducted by League staff, univer- 
sity “associates” (typically a university faculty 
member affiliated with the League), principals, 
or veteran League teachers. 

A League representative, (e.g., a League staff 
member, university associate, or current League 



teacher) visits each school annually. This visit is 
intended to provide school staff with an oppor- 
tunity to discuss progress, concerns, and plans 
with someone who is knowledgeable about the 
approach. For example, schools that are strug- 
gling with action research may work on that 
component during the site visit. Visitors review 
the school’s plan, interview key people and 
groups in the school (including students), and 
provide the school with a summary of what was 
learned. Additional consultations at the school 
are available. 

According to the developer. League schools have 
unlimited access to an Information Retrieval Sys- 
tem based with the developer that provides in- 
formation on issues, concerns, and practices deal- 
ing with the League approach. Schools receive a 
variety of materials on sharing responsibility for 
running the schools and action research, plus a 
biannual newsletter, written by League practitio- 
ners, about the work occurring in League schools. 
League members also can have unlimited tele- 
phone consultation with League staff Finally, the 
League currently is developing a Web site for 
participating schools to share research reports, 
case studies, and best practices from other League 
schools, along with basic information about the 
League. 

Implementation Requirements and Schools^ 
Experiences. Schools that are interested in be- 
coming League members are required to send a 
team of six staff members to a two-day orienta- 
tion workshop for an introduction to the Leagues 
premises and goals. According to the developer, 
teams are composed of the principal, teachers, 
and perhaps parents or district staff. It is expected 
that teachers will represent the majority of par- 
ticipants. The workshop, presented by League 
staff and by staff from veteran League schools, 
covers the history and the framework of the 
League. Typically, but not necessarily, the orien- 
tation takes place at the beginning of December, 
which gives schools enough time to decide 
whether to become a League member for the fol- 
lowing school year. 
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After attending the orientation workshop, the 
team is expected to report back to the entire 
school staff, which then votes (by secret ballot) 
on whether or not to join the League. The League 
requires that at least 80 percent of the school staff 
vote to join. Approval by district administrators 
also is required. Schools then submit a letter of 
application for membership, in which they sign 
a commitment to: collect data to assess their 
progress; establish representative, democratic, 
decision-making procedures; use the decision- 
making process to improve instruction; set school 
instructional goals and work collectively on at- 
taining these goals; and share experiences with 
colleagues in other schools. 

The implementation studies conducted to date 
have found that schools benefit when staff mem- 
bers are provided with the opportunity to dis- 
cuss and ask questions about the League ap- 
proach. It was found that 63 percent of “older” 
schools (those that had implemented the ap- 
proach for several years) had reached consensus 
on their covenant of teaching and learning, com- 
pared to 30 percent of “younger” schools. Eighty- 
one percent of older schools had set up and used 
a system for making decisions, compared to none 
of the younger schools. Finally, 37 percent of the 
older schools had made significant progress to- 
ward doing action research, compared to 20 per- 
cent of younger schools. 

According to several studies, the action research 
component of the framework is the most dif- 
ficult to implement. Researchers suggest sev- 
eral reasons for this, including teachers’ lim- 
ited time and lack of familiarity with research 
methods. 

COSTS 

The first-year cost of adopting the League of Pro- 
fessional Schools is $13,000. This includes re- 
lease time for professional development, a mem- 
bership fee that covers training, and an estimate 
of travel costs for professional development (based 



on the average amount spent by schools AIR in- 
terviewed). 

Because the developer only works with schools 
in the state of Georgia, and, thus, only schools in 
the state of Georgia are allowed to become offi- 
cial “League” schools, estimated costs are given 
presuming schools are located in close proximity 
to the developer. The League does work with 
schools outside of Georgia that want to start their 
own networks, but because the cost of this assis- 
tance (e.g., travel to the site) vary greatly across 
schools, estimates are unavailable for schools out- 
side the state. 

For schools in Georgia, participation in the 
League requires an annual $1,000 membership 
fee, regardless of the size of the school. This fee 
covers professional development and technical 
assistance: specifically, the two-day fall confer- 
ence, the one-day winter meeting, and the op- 
tional one-day spring meeting. The fee also cov- 
ers the professional materials used in training, 
the biannual newsletter, unlimited access to the 
Information Retrieval System, unlimited tele- 
phone consultation with League staff, and a one- 
day visit to the school by League staff or their 
designees. Other consultation to the school is 
available for an additional fee (not specified by 
the developer). 

The developer notes that the $1,000 fee covers 
only one-fifth of the total value of the benefits 
that League schools receive (valued at $5,000); 
the other $4,000 comes from foundations and 
private donations to the League. Moreover, the 
membership of approximately ten percent of 
League schools is covered by a League scholar- 
ship fund. 

League schools incur additional expenses to 
implement the approach. The schools must fi- 
nance any expenses associated with travel to the 
conferences, including release time. Assuming 
that a team of six staff rhembers attends each of 
the three conferences (totaling four days), pro- 
fessional development will require 24 days, plus 
travel time and expenses. (In the first year, 12 
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additional days would be required to attend the 
initial orientation meeting.) 

Further, the process of reform requires a substan- 
tial commitment of time on the part of the staff 
Some schools may pay for release time, others 
may ask staff to volunteer time, others may use 
existing district staff development time, and oth- 
ers may seek grants to pay for substitute teachers 
or to pay teachers for the extra hours they spend 
on the approach. 



CONTACT INFORMATION 
Dr. Lew Allen 

League of Professional Schools 
124 Aderhold Hall 
University of Georgia 
Athens, GA 30602 
Phone: 706-542-2516 
Fax: 706-542-2502 
E-mail: lewallen@cue.uga.edu 
Web site: under development 
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Modern Red 
Schoolhouse 



Evidence of positive effects on student achievement 


? 


Year introduced in schools 


1993 


Number of schools 


50 


Support developer provides schools 


• 


First-year costs 




with new staff 


$215,000 


with current staff reassigned 


No change 


® = Strong (J = Promising Q = Marginal O = 


Mixed, Weak ?= No Research 



OVERVIEW 

Modern Red Schoolhouse was designed to help 
schools achieve standards-based reform, focusing 
on six areas: organization and finance; 
technology; curriculum; standards and assess- 
ment; community involvement; and profes- 
sional development. The approach intends to 
help schools set high academic standards that 
are consistent with district and state assessments 
and cover rigorous core content. The approach 
attempts to build on a schools strengths, address 
weaknesses, and develop a plan for continuous 
self-improvement. In addition, schools are 
expected to assume increasing responsibility for 
many items that are traditionally controlled by 
the district (e.g., budgeting, personnel assign- 
ments, curriculum details, scheduling, teacher/ 



student ratios, and time allotted to various 
subjects). 

Modern Red Schoolhouse is one of several ap- 
proaches sponsored by New American Schools, a 
national initiative to develop replicable schoolwide 
reform programs. Developed in 1992 by the 
Hudson Institute, Modern Red Schoolhouse is 
now a separate private, nonprofit organization. 

According to the developer, the approach was 
built around the idea of a “little red schoolhouse” 
that draws people together for a common pur- 
pose, and was based on research in psychology, 
sociology, and education. The approach was first 
used in six elementary schools in 1993. In 1994, 
two middle schools and one high school were 
added. At the time of this report, 29 elementary 
schools, 14 middle schools, and seven high 
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schools in 1 1 states were using the Modern Red 
Schoolhouse approach, although the developers 
note that only five of these 50 schools have fully 
implemented the program. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Modern Red 
Schoolhouse is a relatively new approach and does 
not yet have a strong research base on student 
achievement. However, the developer has com- 
piled score data and some contextual information 
on the approach. These data do not meet this 
reports criteria for rigorous research, and are not 
discussed here, but are available for public review. 
At the time of this report, 1997-98 test score in- 
formation for 13 schools in six districts was avail- 
able from the developer. In addition. New Ameri- 
can Schools has contracted for evaluation research 
on this and other sponsored approaches. 

Research on implementation is available. As part 
of the larger New American Schools contract, five 
studies provide information on the implementa- 
tion progress of Modern Red Schoolhouse 
schools. 

Effects on Students. No rigorous research stud- 
ies on student achievement are currently avail- 
able. However, the reader is encouraged to ob- 
tain and evaluate the test score data on Modern 
Red Schoolhouse schools that are available from 
the developer. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. According to the developer, full 
imolementation of this a^^T^roach recsuires that 
schools, principals, and instructional staflF have 
considerable freedom in determining how best to 
meet the needs of their students. The approach 
requires districts to give schools more autonomy 
in choosing their curriculum; in assigning, hiring, 
and firing staff; in scheduling classes; and in allo- 



cating school budget funds. Modern Red School- 
house recommends that schools control 80 per- 
cent of their budget by the third or fourth year of 
implementation. The developer suggests that the 
approach may be most effectively and easily imple- 
mented in districts that are decentralized. 

Modern Red Schoolhouse also recommends that 
school staff assemble six committees: community 
involvement; curriculum; organization and fi- 
nance; standards and assessment; technology; and 
professional development. Together with the 
principal, committee chairs form a leadership 
team that may be expanded to include parents, 
faculty members, and community representatives. 

To assist with the development and implemen- 
tation of long-range plans. Modern Red School- 
house trainers work on-site with each of these 
groups. (See the section on Professional Develop- 
ment and Technical Assistance for more details.) 
Schools are encouraged, but not required, to hire 
a technology coordinator. 

Curriculum and Instruction. The developers rec- 
ommend that schools teach eight core subjects 
(math, science, English, history, geography, for- 
eign language, art, and cultural literacy). Schools 
not already teaching these subjects are encour- 
aged to consider using the Core Knowledge cur- 
riculum (described under the Core Knowledge 
profile in this document). 

Modern Red Schoolhouse does not provide or 
require a specific curriculum; rather, the devel- 
oper supports local teachers in developing cur- 
ricula that are coherent across grades. Trainers 
from the developer s staff work at the school to 
help instructional staff develop lesson plans. Scor- 
ing guides (“rubrics”) are then developed by the 
teachers as part of the training program. These 
scoring guides, according to the developer, should 
be consistent with state and local standardized 
tests and should become part of lessons. 

Supplies and Materials. Although no specific 
supplies and materials are provided or required. 
Modern Red Schoolhouse recommends using 
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technology in the classroom for several purposes, 
including sharing information, assessing students, 
and tracking student progress on goals. The de- 
veloper requires that schools have: a network of 
computers, a fileserver, a modem, instructional 
and management software, voice mail, student 
work stations (6:1 ratio), and cable and satellite 
down-links. 

Depending on local circumstances, the devel- 
oper also recommends that schools use the 
Core Knowledge scope and sequence and/or 
Open Court reading materials. Assessment 
materials are provided through “capstone units” 
developed by national experts. According to the 
developer, teachers are trained to find inexpen- 
sive ways to provide suitable materials for their 
students. 

Scheduling and Grouping. The Modern Red 
Schoolhouse encourages schools to build sched- 
ules and group students in ways that promote 
“continuous progress.” Options that schools 
may use include grouping by student perfor- 
mance (i.e., “ability grouping”); grouping stu- 
dents together with the same group of teachers 
for multiple years (i.e., “looping”); scheduling 
after-school or summer programs; having un- 
graded classrooms; and providing time for stu- 
dents to work individually or in small groups 
on projects that the students themselves devise 
and complete (i.e., “self-directed learning”). The 
developer suggests that scheduling should allow 
adequate time for planning lessons and for stu- 
dents to explore topics in depth (particularly in 
the upper grades). 

Monitoring Student Progress and Performance. 

The Modern Red Schoolhouse approach uses 
standardized tests, assessments based on student 
performance, and individual student contracts to 
monitor student progress. Through the required 
Individual Education Compact (lEC), goals are 
developed for each student, with progress toward 
meeting those goals monitored and discussed by 
the student, teacher(s), and parents. Ideally, dis- 



cussing and revising progress reports to parents 
should occur annually. 

Schools are required to use “capstones,” assess- 
ments that gauge student progress in the class- 
room in regard to standards. Teachers and Mod- 
ern Red Schoolhouse trainers also work together 
to develop a curriculum that is consistent with 
tests required by the state or district. 

Family and Community Involvement. Modern 
Red Schoolhouse considers parent and commu- 
nity involvement central to the approach. Par- 
ents are encouraged to become involved in learn- 
ing about classroom activities, assisting in the 
classroom, and, as appropriate, serving on school- 
related committees. Schools are encouraged to 
establish parent centers and to provide referrals 
or establish a network to provide social services. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance, Most professional development is done at 
the school. During the first few years of imple- 
mentation, the developer expects schools to de- 
vote approximately 30 days a year to professional 
development tailored to the schools’ needs. The 
developer reports that many schools prefer to hold 
the five-day inservice over the summer, as an in- 
stitute. The entire staff is expected to participate 
in five additional days of inservice on topics cho- 
sen by the school. In addition, small groups of 
instructional staff are required to participate in 
20 days of group-specific curriculum training. 
Finally, the school committees (e.g., curriculum 
committee, technology committee) are required 
to spend five days in inservice training to focus 
and plan their tasks. During the five annual train- 
ing and technical assistance site visits, the devel- 
oper helps the school evaluate implementation 
progress against benchmarks in its implementa- 
tion plan. 

Although the amount of training is specified by 
the developer, individual schools determine the 



O 

ERIC 



102 



92 



Modern Red Schoolhouse 



exact content of all training and technical as- 
sistance in consultation with Modern Red 
Schoolhouse staff. However, a typical profes- 
sional development package might include the 
following: 

• The process of change: identifying and man- 
aging responses to organizational change. 

• Using standards: research by school staff, scope 
and sequence of the curriculum, development 
of instructional units, assessment based on 
student perforrriance, and strategies for or- 
ganizing both instruction and the classroom 
for instruction. 

• Organizational components: committee and 
leadership development. 

In addition to on-site training tailored to the 
needs of the school, the developer provides 
technical assistance through a toll-free telephone 
number and a Web site. The developer provides 
support for at least the first three years of 
implementation. 

Until recently, all training has been done by the 
core staff of Modern Red Schoolhouse, but as 
the number of schools using this design has 
grown, there has been a corresponding need for 
more trainers. Training for 22 additional trainers 
began in summer 1 998. The developer states that 
all of these trainers have used Modern Red 
Schoolhouse for several years, and they will be 
required to continue their own training. 

Implementation Requirements and Schools^ 
Experiences. Modern Red Schoolhouse encour- 
ages all schools considering the approach to re- 
view informational materials, visit sites, and speak 
to staff members at schools currently using the 
approach. The developer also requires that 80 per- 
cent of the faculty approve the decision to adopt 
the approach (by secret ballot). 

During a pre-implementation planning phase. 
Modern Red Schoolhouse and school staff work 
together at the school to develop a detailed imple- 
mentation plan. The developer also recommends 
involving district staff in this phase. 



Five implementation studies indicate that, ac- 
cording to school staff, the design has had a posi- 
tive influence on school organization, instruc- 
tional strategies used in classrooms, alignment 
of instruction across subjects, collaboration 
among teachers, parent and community involve- 
ment, and student engagement with learning. 
Urban schools reported improvements in both 
student behavior and attendance. According to 
three studies conducted for New American 
Schools, schools report that substantial prepa- 
ration is needed before implementation. These 
studies suggested that schools adopting the ap- 
proach are more successful if they begin with 
changes that directly affect classrooms (e.g., 
changing curriculum and assessment) before 
focusing on changes in governance. 

COSTS 

The first-year cost of adopting Modern Red 
Schoolhouse is $215,000. This includes an 
average fee for training and technical assistance, 
an estimated cost for technology, and estimated 
release time for training (assuming that all 
teachers participate in five days of training and 
groups of eight teachers participate in 25 days of 
training). 

The average school of 500 students can expect to 
pay Modern Red Schoolhouse $60,000 to 
$80,000 per year for each of the first three years 
of implementation. This fee covers the cost of 
trainers and consultants for 30 days of training 
or consultation at the school each year during 
that three-year period. It does not cover “hidden 
costs” such as release time for teachers. There is 
an additional fee for any staff development or 
training beyond the 30 days. According to the 
developer, these costs vary so widely that it is not 
possible to provide an estimate. Further, schools 
that are located farther from Nashville can ex- 
pect to pay the entire amount, and perhaps more, 
due to travel costs. 
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Modern Red Schoolhouse staff report that some 
schools, especially very small schools and schools 
that have experience with performance assess- 
ment, have been able to fully implement the de- 
sign for less than this amount. 

The fee paid to Modern Red Schoolhouse does 
not cover the cost of computer hardware, soft- 
ware, or building rewiring. The developer esti- 
mates this cost to be between $25,000 and 
$300,000 over three years. Schools with few com- 
puter resources should expect their costs to be at 
the high end of that range. Also, schools choos- 
ing to hire a technology facilitator will incur an 
additional cost. 



CONTACT INFORMATION 

Ms. Pam Randall 

Modern Red Schoolhouse Institute 
208 23rd Avenue, North 
Nashville, TN 37203 

Phone: 1-888-ASK-MRSH (1-888-175- 
6774) 

Fax: 615-320-5366 
E-mail: prandall@mrsh.org 
Web site: http://www.mrsh.org 
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Evidence of positive effects on student achievement 


Q 


Year introduced in schools 


1981 


Number of schools 


1,000 


Support developer provides schools 


• 


First-year costs 




with new staff 


$72,000 


with current staff reassigned 


$60,000 


0 = Strong 3 = Promising (i = Marginal ■ O = Mixed, Weak ?= No Research 



OVERVIEW 

Onward to Excellence is an approach that attempts 
to build school capacity for continual improve- 
ment. A series of workshops are provided to help 
teams of teachers, administrators, other school staflF, 
and community members learn to set schoolwide 
goals for increasing student achievement in spe- 
cific areas, to collect data and evaluate progress 
toward achieving goals, and to set new objectives 
once initial goals have been met. 

Schools implement Onward to Excellence in ten 
steps over the course of two years by: 

• conducting an initial assessment to determine 
the schools areas of need; 

• developing a “school performance profile” 
that shows trends in student achievement; 



• establishing one or two broad goals for school 
improvement related to increased student 
performance; 

• studying research on best practices related to 
their school goals; 

• reviewing their current instructional practices 
in relationship to the research; 

• determining how to improve student learn- 
ing in the areas of their goals; 

• developing an implementation plan; 

• carrying out the implementation plan (iden- 
tifying resources, organizing training, and 
changing practices); 

• monitoring progress toward meeting the 
goal(s); and 
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• reviewing the school’s progress toward meet- 
ing its goal(s) and setting new goals after first 
goals have been met. 

Onward to Excellence was developed at the 
Northwest Regional Education Laboratory 
(NWREL) in 1981. The approach resulted from 
research on effective schooling practices, includ- 
ing research on: school effects, teacher effects, 
instructional leadership, curriculum alignment, 
program coupling, and educational change. Pres- 
ently, over 1,000 schools (K-12) have adopted 
the approach. NWREL grants other organiza- 
tions, such as education service centers, state de- 
partments of education, school district offices, 
or universities, permission to conduct training 
using Onward to Excellence, provided that 
NWREL has trained their staff. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Overall, the 
strength of the research base is marginal. Much 
of the research available was conducted by the 
developer. Four studies were reviewed that report 
student outcomes, two of which use a sufficiently 
rigorous methodology to report their findings 
here. One of these was conducted by indepen- 
dent researchers. 

One limitation of the research on Onward to 
Excellence is that, although the approach is 
used in over 1,000 schools across the country, 
studies have focused on schools in the state of 
Mississippi. Still, this limitation is mitigated 
by two factors; one-quarter of all Onward to 
Excellence schools are in Mississippi, and the 
research in Mississippi has been extensive. One 
study examined 33 Mississippi schools; the 
other looked at almost 30 school districts, in- 
cluding almost every Onward to Excellence 
school in Mississippi. 

In addition, three studies have looked extensively 
at the factors that help and hinder the implemen- 
tation of this approach. 



Effects on Students. There is some limited evi- 
dence that Onward to Excellence improves stu- 
dent achievement. Two studies found that well- 
implemented Onward to Excellence schools had 
higher reading test scores than schools not using 
the approach. 

Further, one study provided evidence that On- 
ward to Excellence is effective for schools in high- 
poverty districts. Specifically, when Onward to 
Excellence districts with more than 60 percent 
of students receiving free lunch were compared 
to Onward to Excellence districts with fewer than 
60 percent of students receiving free lunch, it was 
found that the higher-poverty districts had higher 
gains in reading. In addition. Onward to Excel- 
lence students in high-poverty districts were 
found to have significantly greater gains in read- 
ing achievement over two years than did two com- 
parison groups: 1) the average gain across the state 
of high-poverty schools, and 2) a non-Onward 
to Excellence high-poverty control group. 

However, the more typical Onward to Excellence 
school (i.e., a school that does not have a high- 
poverty population or that is not identified as 
implementing the approach especially well) does 
not improve achievement, according to one study. 
In these schools, student achievement did not 
show a pattern of improvement; scores rose and 
fell slightly (not significantly) over time. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Onward to Excellence requires 
that schools establish two teams to lead the re- 
form effort. A School Leadership Team — com- 
posed of the principal plus a combination of 
school staff, community members, and (in sec- 
ondary schools) students — is responsible for guid- 
ing the school and the community through re- 
form. According to the developer, the School 
Leadership Team is trained in the process of im- 
provement; the team, in turn, uses this knowl- 
edge to engage school staff, the community, and 
students in reforms based on reviews of the cur- 
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riculum and instructional practices. In addition, 
the School Leadership Team is responsible for 
drafting the schools implementation plan. 

The second team is the External Study Team, 
which is composed of representatives from edu- 
cational service centers, local universities, the dis- 
trict central office, and other Onward to Excel- 
lence schools. The developer recommends that 
members of the External Study Team have a back- 
ground in research and evaluation methods. (As 
described below, some of the Onward to Excel- 
lence training sessions cover issues related to re- 
search and evaluation, so the External Study Team 
members do not necessarily have to be research 
and evaluation experts.) The External Study Team 
is responsible for collecting data, developing the 
school performance profile, reporting their find- 
ings to the school leadership team and faculty, 
and providing feedback on the schools progress 
toward meeting its goals. 

In addition to the School Leadership Team and 
the External Study Team, each school is required 
to hire a quarter-time facilitator who is respon- 
sible for coordinating implementation in the 
school. Onward to Excellence encourages four 
or five schools that are located in close proximity 
to one another (they do not have to be in the 
same district) to join Onward to Excellence as a 
“cluster” so the schools can share one full-time 
facilitator. According to the developer, one Ex- 
ternal Study Team can serve several schools in a 
cluster, although each school must have its own 
School Leadership Team. 

In terms of administrative support, the developer 
reports that successful Onward to Excellence 
implementation requires a principal who is will- 
ing to share some decision-making responsibil- 
ity with the School Leadership Team. 

Curriculum and Instruction. The developer does 
not provide or require specific instructional strat- 
egies or curricula. However, aligning the school 
curriculum with state and local standards is the 
focus of one training workshop. According to the 
developer, training also focuses on helping teach- 



ers compare current instruction to research-based 
instruction. 

Supplies and Materials. There are no classroom 
instructional materials or supplies associated 
with Onward to Excellence. Some professional 
development materials are provided to workshop 
participants. 

Scheduling and Grouping. Onward to Excellence 
does not provide guidelines for scheduling or 
grouping students. However, the approach does 
require that schools establish common planning 
time for instructional staff to work together. 

Monitoring Student Progress and Performance. 
A central component of Onward to Excellence is 
continuous monitoring of student performance 
by the External Study Team. The External Study 
Teams first role is to develop the schools perfor- 
mance profile, which shows trends in student 
achievement, behavior, and attitude. This pro- 
file is based on standardized test scores, surveys, 
interviews, and group discussions with teachers, 
administrators, parents, students, and other com- 
munity members. The profile helps the school 
identify learning goals and provides a baseline 
against which to measure progress. Onward to 
Excellence does not specify the student perfor- 
mance indicators that the External Study Team 
should analyze; according to the developer, these 
are determined through discussions with the 
School Leadership Team. 

Family and Community Involvement. The 
single explicit requirement for family or com- 
munity involvement is for parents and commu- 
nity members to participate on the School Lead- 
ership Team. Parents and community members 
also are encouraged to participate on the Exter- 
nal Study Team. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical As- 
sistance. Onward to Excellence offers a profes- 
sional development program designed to help 
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school staff learn to set, meet, and refine goals 
for improved student achievement. Schools par- 
ticipate in a series of Onward to Excellence 
workshops, conducted over a period of two years. 
The workshops are conducted at the school by 
Onward to Excellence trainers and attended by 
the School Leadership Team and the External 
Study Team. After each training session, mem- 
bers of the School Leadership Team work with 
the entire faculty, staff, and community on the 
processes learned in the training workshop. 

According to the developer, the workshops fol- 
low a relatively strict schedule to ensure that all 
required training is provided over a two-year pe- 
riod. For example, in the first month, school or 
district administrators attend a half-day Onward 
to Excellence Awareness workshop that reviews 
Onward to Excellence and prepares participants 
for talking with staff and gaining their commit- 
ment. Also during the first month, school board 
members and the superintendent attend a half- 
day session designed to gain their support. Fol- 
lowing is an abbreviated schedule for the remain- 
der of the two-year period: 

• During month two, an Onward to Excellence 
trainer presents a one-day Getting Started 
workshop. After the workshop, schools form 
the two teams. The School Leadership Team 
attends a one-day Introducing Onward to Ex- 
cellence workshop, and the External Study 
Team attends a one-day Conducting Initial 
Assessment workshop. 

• In month three, the School Leadership Team 
attends a one-day workshop on Focusing on 
School Improvement Goal(s)y after which the 
team and faculn^ identify school improve- 
ment goals. 

• In month four, the School Leadership Team 
attends a one-day Mapping the Curriculum 
workshop, as well as a one-day workshop on 
Learning About Best Practices led by the On- 
ward to Excellence trainer. The External 
Study Team also is expected to attend a one- 
day session on Preparing for Self-Study. 



• In month five, the School Leadership Team 
attends a one-day workshop on Developing a 
School Improvement Plan, and then writes the 
plan based on discussions with staff 

• In month six, the School Leadership Team 
attends a one-day session on Taking Action 
on the School Improvement Plan, and the Ex- 
ternal Study Team attends a one-day work- 
shop on Monitoring Progress. 

• In month nine, the trainer visits the school 
to guide the School Leadership Team and the 
External Study Team in establishing networks 
of experienced people who can help the 
school implement Onward to Excellence. 
Specifically, teams learn to establish a princi- 
pal support network, a network for schools 
that have common improvement goals, and 
networks related to quality teaching practices. 

• In month 2 1 (or three months before the end 
of the second year), the trainer conducts a 
one-day workshop for key people who are 
new to Onward to Excellence, PreparingNew 
Leaders. 

• At the end of the second year, the School 
Leadership Team and External Study Team 
attend a one-day workshop on Renewing the 
Onward to Excellence Process. 

In total, according to the developer, the School 
Leadership team needs approximately seven days 
for training and six days for follow-up and plan- 
ning per year; any additional support teams 
formed (e.g., a study team of stakeholders) need 
approximately three to five days per year for their 
work; and the entire faculty could expect to spend 
three days on training. During each training visit, 
the developer provides technical assistance as well 
as structured training. 

Between each of these workshops. Onward to 
Excellence provides guidance to schools, answer- 
ing any questions that arise as they implement 
the approach. In addition to the professional de- 
velopment provided by Onward to Excellence 
trainers (the workshops described above), schools 
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are expected to identify and contract with experts 
who can provide training related to the schools’ 
goals. 

Implementation Requirements and Schools’ Ex- 
periences. According to the process described by 
the developer, schools interested in implement- 
ing Onward to Excellence should have represen- 
tatives from the school or the district attend a 
half-day orientation to become familiar with the 
approach. These individuals are expected to re- 
port back to school staff, who should reach con- 
sensus before moving forward. After the staff 
reaches consensus, representatives present infor- 
mation to the school board, which must agree to 
support the school’s involvement with the ap- 
proach. If the school board agrees, it spends two 
hours with the Onward to Excellence trainer to 
discuss its role and responsibilities in supporting 
the school. 

After this groundwork, the school establishes 
School Leadership and External Study Teams and 
appoints the facilitator. The facilitator then works 
with a School Leadership Team chairperson to 
plan meetings, document discussions and deci- 
sions, follow through on selected tasks on behalf 
of the team, and monitor progress. The first ma- 
jor objective is to identify the school’s improve- 
ment goal(s) based on the findings from the 
school performance profile. If no obvious learn- 
ing goal arises from the profile, the staff, admin- 
istration, students, parents, and the community 
continue discussions until consensus is reached 
on one or two goals. The External Study Team 
helps the School Leadership Team develop a sys- 
tem for tracking implementation progress. 

Schools are offered a second implementation 
option: rather than committing to the complete 
training package (a minimum of seven workshops 
in two years), schools may decide that. they need 
only limited assistance, or that they lack the re- 
sources to commit to the full program. Such 
schools can choose selected services that allow 
them to work on specific areas. Workshops are 
available on topics such as engaging the commu- 



nity in goal-setting, establishing a focus for im- 
provement efforts, and profiling student perfor- 
mance. This type of implementation includes at 
least two workshops separated by enough time 
for schools to try out ideas between sessions. 
However, the developer recommends that schools 
use the complete, seven-workshop package to 
“foster the highest degree of success over time.” 

Implementation studies show that a number of 
schools have been able to implement Onward to 
Excellence fully, although some components seem 
to be easier to implement than others. Typically, 
schools were able to identify goals related to stu- 
dent performance, and showed progress toward 
achieving those goals. In schools that imple- 
mented Onward to Excellence well, the school’s 
goals were well known to the staff, and nearly all 
of these schools kept performance data that 
aligned with their goals. 

Studies also found that the degree of implemen- 
tation tended to diminish gradually over tirne: 
leadership teams operated more loosely, or stu- 
dent performance profiles were not updated; 
monitoring became more informal; and improve- 
ment goals were not renewed. Of 36 schools sur- 
veyed in one study, six had discontinued Onward 
to Excellence because they were no longer inter- 
ested in using the approach, the principal left, or 
the reform lost momentum. 

One study identified four strategies to facilitate 
implementation. First, schools should gain sup- 
port from policymakers, program developers, 
foundations, and local educators. Second, schools 
should identify a group of local trainers who are 
familiar with the school and are committed to 
ensuring that the approach works. Third, schools 
should set a common focus on student learning 
to help unify the school community. Fourth, 
schools should develop both internal and exter- 
nal support systems to sustain the required en- 
ergy and commitment. 
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COSTS 

The first-year cost of adopting Onward to Excel- 
lence is $72,000. This includes half of the two- 
year professional development fee, estimated ex- 
penses for staff release time, travel for developer 
staff, and a quarter-time facilitators salary. The 
first-year cost can be reduced to $60,000 if the 
quarter-time facilitator is a current staff member 
who is reassigned to fill this role. 

The cost of the training workshops is $15,000 
for two years. This fee covers all seven workshops 
and any technical assistance provided between 
workshops. The fee does not include travel ex- 
penses for the NWREL trainer, which schools 
must cover. Also, the fee for the workshop is 
$16,500 if the school is located more than 1,000 
miles from the trainer. There are also provisions 
for training offered by other organizations ap- 
proved by NWREL. If another organization pro- 
vides training, the organization providing train- 
ing sets the cost, with the caveat that the cost 
may not be greater than that established by 
NWREL. According to the developer, having an- 
other organization provide training is often less 
expensive for schools because of reduced travel 
expenses (presuming the other organization is 
closer to the school). 

Schools can also reduce costs significantly by join- 
ing a school cluster. One Onward to Excellence 
trainer can conduct workshops for up to four 
schools at a time, with the schools dividing the 
cost, (This is an option only if the schools can 
meet in one place for the training.) For example, 
if there were four schools in a cluster, each would 



pay one-fourth of the total cost for training, or 
$3,750. Schools in clusters also can share the 
travel expenses of the trainer. 

In addition to training fees, schools pay the sal- 
ary of a quarter-time facilitator, (Joining in a clus- 
ter does not reduce this expense.) Schools also 
cover release time for School Leadership and Ex- 
ternal Study Team members, estimated by the 
developer at approximately 13 days per year for 
an average of four members; release time for ap- 
proximately three four-member study teams es- 
timated at four days; and release time for all teach- 
ers, estimated at three days per year. 

Finally, schools may have to purchase additional 
supplies or instructional materials, or contract 
with content experts for additional professional 
development activities directly related to the 
schools learning goal(s). 



CONTACT INFORMATION 
Dr. Robert Blum 

Northwest Regional Education Laboratory 

School Improvement Program 

101 SW Main Street, Suite 500 

Portland, OR 97204 

Phone: 503-275-9615 

Fax: 503-275-9621 

E-mail: blumb@nwrel.org 

Web site: http://www.nwrel.org/scpd/ote 
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Evidence of positive effects on student achievement 
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OVERVIEW 

The Paideia approach is designed to help stu- 
dents acquire content knowledge and develop 
critical thinking and problem-solving skills. 
Developed in 1982 by philosopher and educa- 
tor Mortimer Adler (philosophy professor at the 
University of Chicago at the time), and a group 
of his colleagues known as the Paideia Group, 
the Paideia approach focuses on changing class- 
room practice in three “columns” of instruction: 

• Didactic teaching — instruction led by the 
teacher; 

• Coaching — individual instruction with one- 
on-one guidance from the teacher; and 

• Socratic seminars — small-group discussions 
facilitated by the teacher. 



Since 1982, the Paideia approach has been 
adopted by more than 80 elementary and sec- 
ondary schools across the country. The program 
is now run by the National Paideia Center (first 
established in 1988) at the University of North 
Carolina. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. The research on 
this approach is weak. According to the National 
Paideia Center, research dates back to the mid- 
1980s. Most has focused on the effects of 
“Socratic seminars” rather than on the other two 
“columns” of instruction. 
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Four of the seven outcome studies available for 
review met our selection criteria for study design 
and methodology. Three of the four were con- 
ducted independently of the developer. The ma- 
jor strengths of these research studies are the 
quasi-experimental and experimental designs; the 
weakness is a limited ability to generalize the stud- 
ies to other situations. 

In addition, the School of Education at the Uni- 
versity of North Carolina has undertaken a four- 
year comprehensive study ( 1997 - 2001 ) to evalu- 
ate the effect of the Paideia approach on teach- 
ing and learning. One of the studies reviewed 
examined first-year outcomes of this research. 
Data on further years of implementation will be 
available as the study progresses; readers inter- 
ested in Paideia are encouraged to follow this re- 
search in the future. 

Effects on Students. Overall, the studies show 
mixed effects on student achievement. Although 
one study indicated negligible effects, another 
showed improved mean test scores for girls. Spe- 
cifically, girls participating in Paideia seminars 
performed significantly better on the Cornell 
Critical Thinking Test than girls who did not par- 
ticipate. No differences in the performance of 
boys were found. Another study found that, for 
one school, students who participated in Paideia 
seminars had a better grasp of key concepts than 
students not participating in such seminars; how- 
ever the opposite was true for another school in 
the study. 

Of the seven outcome studies available for re- 
view, three also provided information on imple- 
mentation. Schools that have fully implemented 
Paideia have higher achievement levels; it is dif- 
ficult, however, to determine whether better 
implementation of Paideia caused higher test 
scores, or whether schools with higher test scores 
implemented the approach better. 



CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. According to the developer, the 
entire school must be changed to fully implement 
Paideia. The National Paideia Center requires that 
each school designate a full-time approach facili- 
tator, whose primary responsibility is to coordi- 
nate and assist implementation activities at the 
school level. 

The developer also notes that administrative sup- 
port and teacher buy-in are critical to the success 
of the approach because it requires radical changes 
to traditional instruction. For example, Paideia 
puts more emphasis on coaching and classroom 
seminars than on teacher-centered lectures, which 
traditionally take up a large amount of instruc- 
tional time. 

Curriculum and Instruction. The Paideia ap- 
proach stresses that all students should develop 
reading, writing, listening, speaking, and critical 
thinking skills through a liberal arts curriculum. 
It also promotes other curriculum activities — 
such as fine arts, athletic activities, and music — 
that center around core academic subjects. 

Although traditional teacher-led instruction is 
one of the three main instructional practices, 
coaching and seminars actually form the core 
of the Paideia approach, according to the de- 
veloper. The developer believes that, through 
coaching and seminars, students learn to ex- 
plore ideas, develop fundamental thinking 
skills, and apply their knowledge and skills in 
real-life situations. 

Supplies and Materials. Paideia does not provide 
or require special instructional materials. Schools 
are expected to select their own materials. 
However, the developer does encourage the use 
of “classics in the classroom”— great literature, 
art, and music— a term more recently broadened 
by the developer to include “contemporary 
classics,” such as The Cobr Purpkhy 
The developer also recommends that the 
classroom include a variety of printed materials. 
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including high-quality student projects and 
exhibits. 

Scheduling and Grouping. The developer rec- 
ommends that schools set aside time for teacher 
and student planning and schedule the school 
day in response to the needs of the varied cur- 
riculum. For example, schools may need to set 
aside larger blocks of time for seminars. 

Although scheduling will vary according to spe- 
cific curriculum objectives, Paideia recommends 
that only 10 to 15 percent of instructional time 
be spent on didactic teaching. According to the 
developer, 60 to 70 percent of instructional time 
should be devoted to coaching, and 1 5 to 20 per- 
cent to classroom seminars. Also recommended 
are a two- to three-week period for “coached” stu- 
dent projects (from assignment to completion), 
and up to two hours each week for seminars. 

Grouping is flexible in the Paideia approach, with 
teachers responsible for grouping students within 
classes and determining the size of seminar 
groups. In some cases, seminars involve cross- 
classroom grouping. 

Monitoring Student Progress and Performance. 
In the Paideia approach, teachers determine in- 
structional goals based on content and curricu- 
lum standards, then measure student perfor- 
mance against these goals. Accordingly, evalua- 
tion should focus on the progress of individual 
students. 

For this reason, the developer does not require 
specific tools for assessment. However, accord- 
ing to the National Paideia Center, the approach 
emphasizes assessments that are rooted in each 
students work, including checklists completed 
by students and teachers together, rubrics, narra- 
tive assessments that describe student progress, 
and portfolios of student work. 

Family and Community Involvement. Paideia 
emphasizes (but does not require) family and 
community involvement as an integral part of 
the approach. According to the developer, Paideia 
schools encourage parent participation in activi- 



ties designed both for children and adults, par- 
ticularly through afternoon and evening pro- 
grams. The developer encourages schools to train 
parents and community members to lead student 
seminars. In addition, the developer encourages 
schools to use a community seminar, with texts 
discussing democracy, to help strengthen civic 
participation in the school community. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. According to the developer, professional 
development is critical to the programs success 
because Paideia requires changes in instruction. 
For the first three years of implementation, the 
developer requires four days of staff training be- 
fore the start of each school year. Training at the 
school is available through the National Paideia 
Center, which provides 25 to 35 person-days of 
school-level training and guidance each year to 
each school. This includes helping schools select 
instructional materials, as well as training teach- 
ers in using the Paideia method. Such training 
requires the use of staff development days or re- 
lease time for all participants. 

In addition to monthly school visits, the devel- 
oper supports program implementation through 
special publications and events. The National 
Paideia Center also reports that it is currently 
focusing on building support networks of 
Paideia schools. Information about the Paideia 
approach and demonstration schools, including 
relevant research and evaluation studies, is avail- 
able through the developer s Web site. The Cen- 
ter is attempting to build a “virtual community” 
Web site that will feature Paideia schools from 
around the country. 

Implementation Requirements and Schools’ Ex- 
periences. Schools must apply to and gain ap- 
proval from the National Paideia Center before 
they can begin implementing the Paideia approach. 
The minimum requirements for approval are: 
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• an awareness presentation by a National 
Paideia Center representative; 

• a favorable vote by at least 80 percent of the 
school staff; 

• a set-aside of funds by the school for start-up 
training and training materials; 

• a commitment to provide a full-time Paideia 
facilitator at the school (teaching one class at 
most); and 

• a commitment to a system of teachers coach- 
ing each other to support implementation. 

The developer suggests a period of three years as 
the general time frame for program implementa- 
tion. Each year is devoted to one major aspect of 
the program. For example, implementation starts 
with the Paideia seminar in the first year, followed 
by coaching in the second year and assessment in 
the third year. During school visits, the developer s 
staflF meets with the principal and the facilitator, 
demonstrates classroom techniques, observes 
classes, and meets with school staffin small groups 
to discuss implementation-related issues. 

Studies addressing implementation show varied 
results. An independent study of the Paideia pro- 
gram in four Chicago public schools — two el- 
ementary and two high schools — indicates that 
the Paideia approach is relatively easy to imple- 
ment. This study also shows teachers’ attitudes 
toward the approach as generally positive. How- 
ever, the three different types of instruction, 
though consistent across the study schools, ap- 
peared to differ from developer recommenda- 
tions. For example, in terms of time allocated to 
the three types of teaching, more emphasis was 
given to didactic teaching than to seminars. 
Teachers reportedly allocated nine hours per week 
to didactic instruction, two hours to seminars, 
and one hour to coaching. 

Another study chronicled the history of the Paideia 
approach in five urban schools in Chattanooga, 
Tennessee. At the time of the study, three schools 
had been using the approach for two years, one 



school for three years, and one school for almost 
nine years. Overall, the actual implementation of 
the approach compared favorably with the crite- 
ria recommended by the developer, and replica- 
tion of critical components had been achieved in 
all five schools. However, as the schools tried to 
“home-grow” the Paideia principles (i.e., adapt- 
ing the principles to their own needs), integrity of 
implementation began to vary across the schools. 
For example, the study found that the use of the 
Socratic method varied within and across schools, 
and schools modified schedules to accommodate 
seminars based on their own needs. 

A third study examined implementation of the 
Paideia approach in a variety of schools in an ur- 
ban district. Overall, the process of implementa- 
tion was considered slow and uneven, with the 
quality of implementation varying greatly across 
sites. Schools with a history of high performance 
showed greater implementation than other 
schools. 

COSTS 

The first-year cost of adopting Paideia is 
$ 146,000. This cost covers professional develop- 
ment, including teacher release time, and the sal- 
ary of a full-time facilitator. Schools can reduce 
this cost to $96,000 by reassigning a current staff 
member to serve as the facilitator. 

Start-up costs for training and materials are ap- 
proximately $50,000 to $70,000 for the first year. 
Included in these costs are training and imple- 
mentation visits by the National Paideia Center 
staff, telephone assistance, training materials for 
each teacher/participant, and all costs of travel 
for the developer staff 

Schools are also responsible for compensating 
teachers who attend other training sessions such 
as conferences. 



104 



114 



Paideia 



CONTACT INFORMATION 

Dr. Terry Roberts 

National Paideia Center 

School of Education, UNC-Greensboro 

P.O. Box 26171 

Greensboro, NC 27402-6171 

Phone: 336-334-3729 

Fax: 336-334-3739 

Web site: call for information 



O 

ERIC 



115 



105 



An Educators’ Guide to Schoolwide Reform 



Roots and Wings 



Evidence of positive effects on student achievement 




Year introduced in schools 


1993 


Number of schools 


200 


Support developer provides schools 


• 


First-year costs 




with new staff 


$270,000 


with current staff reassigned 


$70,000 
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OVERVIEW 

Note: Roots and Win^ incorporates and builds upon 
Success for AIL To better understand both the read- 
ing component of Roots and Wings and other gen- 
eral issues, the reader is encouraged to review the 
Success for All profile. 

Designed to be used in conjunction with the Suc- 
cess for All reading program^ Roots and Wings is 
a comprehensive model that seeks to provide chal- 
lenging content and experiences to children in the 
major core content areas of reading and language 
arts, mathematics, science, and social studies. 

The main goal of the approach is to improve aca- 
demic achievement in elementary schools. Second- 
ary goals include reducing the number of referrals 
for special education, reducing the number of stu- 



dents who are retained in grade, increasing atten- 
dance, and addressing family needs. 

Roots and Wings is one of several approaches 
sponsored by New American Schools, a national 
initiative to develop replicable schoolwide reform 
programs. It was created in 1993 by the develop- 
ers of Success for All, Robert Slavin and Nancy 
Madden, at the Johns Hopkins University, to ex- 
tend the Success for All curriculum. Over 1,130 
pre-K-6 schools in 44 states have adopted Suc- 
cess for All, with over 200 of the schools using 
Roots and Wings. The approaches also have been 
adapted for use in Canada, Mexico, Australia, 
Israel, and England. Although it is geared prima- 
rily to urban environments, a wide range of 
schools now use the approach. The developers 
plan to add 400 to 600 schools per year. 
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EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Roots and Wings 
is a relatively new program, and its research base 
on student achievement is still marginal. How- 
ever, the Success for All approach, which pro- 
vides the Roots and Wings reading curriculum 
and other program components (e.g., parent sup- 
port and one-on-one tutoring), has a well-estab- 
lished research base that should be examined 
when considering Roots and Wings. Three stud- 
ies are available that look at the student achieve- 
ment effects of Roots and Wings in other con- 
tent areas. Two of these studies (one conducted 
by independent researchers) were sufficiently rig- 
orous to report results here. 

In addition, a comprehensive evaluation of this and 
other sponsored approaches has been commissioned 
by New American Schools. Five implementation 
studies also were reviewed, three of which were con- 
ducted under contract for New American Schools. 

Effects on Students. While research on student 
achievement effects is still limited, preliminary 
results are encouraging. Both rigorous studies 
present data from standardized tests (e.g., the 
Maryland State Performance Assessment Pro- 
gram, Texas Assessment of Academic Skills, Com- 
prehensive Test of Basic Skills, and Tennessee 
Comprehensive Assessment Program) indicating 
that Roots and Wings helps improve student per- 
formance across all subjects tested (i.e., reading, 
language, math, science, social studies). In most 
cases, improvement was at educationally signifi- 
cant levels. In one study. Roots and Wings schools 
that scored below comparison groups (e.g., state 
average, other schools in the district) imple- 

menting the approach scored significantly higher 
than comparison groups when tested after imple- 
menting the approach. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Schools may need to make a 



number of substantial changes to implement 
Roots and Wings. In addition to the changes re- 
quired for Success for All (e.g., additional staff, 
restructured reading groups, possible changes in 
special education and retention policies), the 
“Math Wings” and “WorldLab” components of 
Roots and Wings require modifying instructional 
strategies. In WorldLab, for example, students 
focus on problem-solving, and teachers are ex- 
pected to act as guides to students rather than 
lecturers. As with Success for All, Roots and 
Wings requires a full-time facilitator and approxi- 
mately three tutors. 

Curriculum and Instruction. According to de- 
velopers, Roots and Wings emphasizes student- 
led, cooperative activities. Roots and Wings uses 
the same reading curriculum as Success for All. 
(For more details on the reading curriculum, see 
the Success for All profile in this report.) 

The developer provides a mathematics curriculum, 
entided Math Wings, that aligns with the National 
Council ofTeachers of Mathematics guidelines and 
standards. It has three main components: 

• a daily routine of problem solving, facts, home- 
work check, logbook, and team organization; 

• a series of units, spanning three to five weeks, 
that involve the whole class and include 
project (performance-based) tasks as the in- 
troductory lesson; and 

• a two-week period, scheduled to occur between 
most whole-class units, when students are work- 
ing individually on building or refining skills 
or investigating additional math topics. 

WorldLab, a curriculum that combines science and 
social studies, encourages students to investigate 
real-world problems and topics in small groups. 
Central components of World Lab include: 

• a design that promotes an understanding of 
the interdependence of economic, political, 
biological, and physical systems; 

• use of simulation (role playing), group in- 
vestigation, and cooperative learning; 
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• involvement of community resources, (i.e., 
people in the community who have relevant, 
specialized knowledge); 

• encouragement of problem solving and 
higher-order thinking; and 

• student projects that help solve community 
problems. 

Some of the WorldLab units for grades one and 
two are Birds, Forests, and Harvests around the 
World, Units for grades three through six include 
Archeology, Encounters (which looks at interactions 
among cultures from ancient times through the 
early American settlement). From Rebellion to 
Union, and Inventors, 

Supplies and Materials. In addition to the cur- 
riculum materials for Success for All, Roots and 
Wings schools use instructional materials that 
support the WorldLab and Math Wings curricula 
described above. 

Scheduling and Grouping. As with Success for 
All, schools implementing Roots and Wings 
group students by achievement level for read- 
ing. According to the developers, students work 
in heterogeneous homerooms during Math 
Wings and World Lab. Students also stay in 
homeroom groups of mixed achievement levels 
for other subjects. 

In addition, the schedule of a Roots and Wings 
school is structured. The developers require 
schools to set aside 90 minutes for reading, one 
hour for math, and 60 to 90 minutes for 
WorldLab each day. 

Monitoring Student Progress and Performance. 

In addition to Success for All reading assessments, 
which are administered every eight weeks. Roots 
and Wings has ongoing informal assessments 
built into the math and WorldLab curricula. 

Family and Community Involvement. Roots and 
Wings contains the same family and community 
involvement component as Success for All. This 
requires establishing a family support team at each 
school. 



SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. In addition to the extensive training pro- 
vided for Success for All, the developers provide 
specific training for the components particular 
to Roots and Wings over three years of imple- 
mentation. (For more details, see the Success for 
All profile in this report.) 

During the first year, this includes three two- 
day visits that focus on implementation of the 
curriculum and two one-day visits that focus 
on family support. Generally, the developer pro- 
vides training in one content area at a time so 
that teachers have time to gain proficiency in 
one subject before attempting the next. The 
developer uses an implementation visit record 
form, which can be used by the schools between 
visits to track implementation progress. Dur- 
ing these visits, the developers also provide tech- 
nical assistance for implementation. In addition 
to on-site training and technical assistance, the 
developer assigns a staff member to work closely 
with each school over the telephone or through 
other means of contact. The developer also pro- 
vides information through a Web site. 

Implementation Requirements and Schools’ Ex- 
periences. The implementation requirements for 
Roots and Wings closely mirror those for Suc- 
cess for All. 

• District and school staff are encouraged to 
examine program materials and visit other 
schools to become familiar with the program. 

• A secret ballot must be taken in which at least 
80 percent of school staff vote to adopt the 
approach. 

• A full-time facilitator must be provided. 

• At least one certified teacher tutor and three 
other tutors must be provided. 

• Staff for the family support team must be 
provided. 
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Five studies provide information about the imple- 
mentation of Roots and Wings. A consistent find- 
ing is that schools do not generally implement 
the entire Roots and Wings approach all at once. 
Many schools start by implementing Success for 
All, and then add the two additional Roots and 
Wings corhponents (WorldLab and Math Wings) 
one at a time. Further, there are mixed results 
when implementing Roots and Wings: 

• Implementation was stronger in the early 
grades than in later grades. 

• The components of frequent assessment, 
longer reading classes, smaller reading classes, 
and cross-grade regrouping were imple- 
mented in most sites. However, teachers had 
trouble implementing cooperative learning in 
the upper grades. 

COSTS 

The first-year cost of adopting Roots and Wings 
is $270,000. This includes professional develop- 
ment, including teacher release time; materials; and 
salaries for a full-time facilitator and an average of 
three tutors. However, schools can reduce this cost 
to $70,000 by reassigning current staff to serve as 
the full-time facilitator and reading tutors. 

Costs depend on the size and location of schools 
and the number of schools in a district that share 
training and travel costs. As a low estimate (not 
including personnel) for the full approach for a 
school of 500 students, the developers cite a fig- 
ure of $70,000 per year for years one through 
three. This estimate is based on the assumption 
that the school will implement one aspect of the 
approach (i.e.. Success for All, Math Wings, 
WorldLab) each year. While the school may not 
choose to use both Math Wings and WorldLab, 
the developers recommend using Success for All 
before adding either or both Roots and Wings 
components. 

Additional costs, not included in the $70,000 es- 
timate, are staff, such as a full-time facilitator, and 
three tutors (according to the developers, these 



positions are generally filled by reassigning exist- 
ing staff); substitutes and release time for train- 
ing; and development of a family support team. 

When additional personnel costs are considered, 
the figure rises substantially. Estimates from New 
American Schools detail a yearly cost of $224,000 
to $324,000, including personnel, materials, 
training, and other operating costs. The figure 
varies depending on the number of additional 
personnel considered. Also, although the figure 
drops slightly because of decreased training after 
the first year of implementation, the figure re- 
mains high in the second and third years because 
most of the costs are incurred for personnel. New 
American Schools estimates costs by year four at 
$ 1 87,000 to $287,000, depending on how many 
staff positions are reallocated versus hired. Ac- 
cording to the developers, in Title 1 schools, ex- 
isting Title 1 staff usually fill the roles of facilita- 
tors, tutors, and family support team staff; there- 
fore, these additional costs are not incurred. 

Other estimates vary somewhat, but still reflect 
the substantial personnel costs. For example, 
Keltner and Reichardt (1998) estimate an imple- 
mentation cost for Roots and Wings of $298,900. 
Estimates of total costs, given by the developers 
for the original site in St. Mary’s County, 
Maryland, were $219,738 for the start-up year 
and $133,238 for continuing years. Again, all of 
this may not represent new revenues since existing 
staff may have been reallocated. 



CONTACT INFORMATION 

Dr. Robert Slavin 

Success for All/Roots and Wings 

200 W Towsontown Boulevard 

Baltimore, MD 21204 

Phone: 800-548-4998 

Fax: 410-324-4444 

E-mail: info@successforall.net 

Web site: http://www.successforall.net 
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School Development 
Program 



Evidence of positive effects on student achievement 
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Year introduced in schools 
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Number of schools 
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Support developer provides schools 
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First-year costs 
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$45,000 


with current staff reassigned 


$32,000 
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OVERVIEW 

The School Development Program (SDP) was 
founded in 1968 by James Comer, a child psy- 
chiatrist at Yale University. The approach is 
based on the theory that children learn bet- 
ter when they form strong relationships with 
the adults in their lives — including parents, 
teachers, and members of church and other 
community groups — in an environment of 
mutual respect. The main goal of the program 
is to develop in students the personal, social, 
and moral strengths necessary to achieve suc- 
cess in school. The School Development Pro- 
gram addresses these issues with nine essen- 
tial elements: 



• three mechanisms (the School Planning and 
Management Team, the Student and Staff 
Support Team, and the Parent Team); 

• three operations (the Comprehensive School 
Plan, the Staff Development Plan, and As- 
sessment and Modification); and 

• three guiding principles (no-fault problem 
solving, consensus decision-making, and 
collaboration). 

The School Development Program was first 
implemented in 1968 in two elementary schools 
in New Haven, Connecticut, and now operates 
in more than 700 schools. It is primarily an ap- 
proach for elementary schools serving disadvan- 
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raged students, although it has also been used in 
middle and high schools. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. The School De- 
velopment Program has promising research on stu- 
dent achievement effects. Research has been con- 
ducted by both the developers and independent 
evaluators, which lends strength to the findings. 
Twelve studies that presented student academic 
outcomes were available. Of these studies, three — 
one conducted by the developers and two con- 
ducted by independent researchers — ^were consid- 
ered rigorous enough to report the findings here. 

Eleven studies, including detailed case studies and 
studies collecting both quantitative and qualita- 
tive data, report on schools’ use of the School 
Development Program and the factors related to 
its successful implementation. Four of these stud- 
ies describe both implementation and student 
outcomes. 

Effects on Students. The three rigorous studies 
on outcomes indicate that the School Develop- 
ment Program has positive effects on students’ 
achievement. One research review, for example, 
found that schools using the School Development 
Program model had significantly higher academic 
achievement than that of non-School Develop- 
ment Program schools in reading, mathematics, 
and language, measured by scores on the Iowa 
Test of Basic Skills and classroom grades. This 
finding is supported by the other two studies, 
which found that students in School Develop- 
ment Program schools tended to have higher test 
scores and grades, and to show greater improve- 
ment over time, compared to students who were 
not m such schools, ivc^cait^n ^uggc^t^ LnaC 
effects persist and may increase over time. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Implementing the School De- 



velopment Program requires significant organi- 
zational change. The developers expect districts 
using this approach to have a facilitator to serve 
all schools using the approach. As described 
above, the three mechanismSy three operations, and 
three guiding principles must be implemented, 
each of which affects school organization, staff, 
and administration . 

The first mechanism is the School Planning and 
Management Team, composed of approximately 
12 teachers, parents, professional support staff 
(e.g., social workers, school psychologists), and 
paraprofessional staff (e.g., classroom aides, sec- 
retaries, janitors). The principal is the group 
leader. As described by the developers, the 
School Planning and Management Team has 
four major responsibilities: (1) establish poli- 
cies that affect the curriculum, school environ- 
ment, and staff development; (2) carry out 
school planning, resource assessment, program 
implementation, and evaluation of the curricu- 
lum, school environment, and staff develop- 
ment; (3) coordinate the activities of all indi- 
viduals, groups, and programs in the school; and 
(4) work with parents to establish a calendar of 
social activities for the school. 

The second mechanism is the Student and Staff 
Support Team, composed of teachers, school psy- 
chologists, social workers, special education teach- 
ers, counselors, and other support service staff 
The Student and Staff Support Team provides 
input to the School Planning and Management 
Team on ways to integrate mental health prin- 
ciples into school management, to ensure that 
the school environment supports the students’ 
learning and developmental needs. The Student 
and Staff Support Team also supports individual 
classroom teachers in regard to particular students 
who may oe naving airncuities witn benavior or 
learning. The team is expected to meet weekly to 
discuss students referred by classroom teachers. 

The third mechanism, the Parent Team, supports 
activities to involve parents in the school. There 
are different levels of participation, so parents can 
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choose how involved they wish to be. All parents 
are encouraged to participate in several school- 
sponsored activities each year, such as a field trip 
to a museum. These activities allow parents to 
get to know members of the school staff, so they 
feel more comfortable with the school. Parents 
who wish to be involved more directly are en- 
couraged to participate as classroom assistants, 
tutors, or aides. Finally, parents who are com- 
mitted to being highly involved can participate 
as members of the School Planning and Man- 
agement Team. 

The operations that must be put into place in- 
clude: adopting a Comprehensive School Plan, 
which lays out specific goals for the school in 
terms of both climate and academic areas; adopt- 
ing a Staff Development Plan, which focuses 
teacher training on needs related to the goals 
specified in the Comprehensive School Plan; 
and developing a monitoring and assessment 
system to track progress toward meeting the 
schools goals. 

The behavior and actions of staff are expected to 
be guided by three principles. 

No-fault solving means that, when prob- 

lems arise, individuals focus on finding solutions 
rather than assigning blame. 

The second guiding principle is consensus decision 
making. The developers believe that consensus 
decision making is preferable to making decisions 
by majority vote. The idea is that reaching con- 
sensus forces individuals to discuss their differences 
and understand each others points of view, while 
voting forces individuals to choose sides. In addi- 
tion, voting results in ‘winners” and “losers,” which 
is not conducive to building strong, mutually re- 
spectful relationships. 

The third and final guiding principle is collabo- 
rationy which means that the principal and the 
teams work together to lead the school reform 
process. 

Curriculum and Instruction. Although no par- 
ticular curriculum is provided or required, the 



developers offer a curriculum called “Literacy 
Initiatives,” for improving reading skills at the 
elementary school level. The developers also con- 
duct a literacy audit with each school. According 
to the developers, this involves a review of state 
and district standards (especially in literacy, but 
across all subjects) as well as test score patterns 
over several years. School staff, working with the 
developers, then are supposed to identify stan- 
dards upon which to focus. 

Supplies and Materials. The School Develop- 
ment Program does not provide or require par- 
ticular supplies or instructional materials. De- 
cisions regarding supplies and materials are left 
to the discretion of the school. However, in ad- 
dition to offering the Literacy Initiatives, the 
developers are working on “Curriculum Align- 
ment for Instructional Improvement,” linking 
schools’ expectations of students with state and 
national standards, and linking those standards 
to school curricula, textbooks, tests, and class 
organization. 

Scheduling and Grouping. The School Devel- 
opment Program does not offer guidelines for 
scheduling classes or for grouping students within 
classrooms. According to the developers, these 
decisions should be based on data about student 
performance and discussions of the school plan- 
ning and management team. 

Monitoring of Student Progress and Perfor- 
mance. According to developers, a key compo- 
nent of the approach is ongoing research on stu- 
dent achievement. A national database that tracks 
student academic performance, as well as student 
outcomes on multiple measures of school envi- 
ronment, is maintained. According to the devel- 
opers, students identified as having reading prob- 
lems through this process participate in reading 
labs using work stations. 

Family and Community Involvement. The de- 
velopers believe that parental involvement in the 
school is essential for students to achieve their 
potential. The Parent Program provides struc- 
tured opportunities for parents to become in- 



112 



122 



School Development Program ‘ 



volved in decision making, spend time in the 
classroom as tutors or aides, or simply partici- 
pate in social activities involving the entire school 
community. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. An initial training session to orient partici- 
pants to the approach is provided in May prior to 
the first year of implementation. This week-long 
workshop, held at Yale University, is attended by 
district facilitators and principals from participat- 
ing schools; teachers and parents may also attend. 
The following February, the same group attends a 
second week-long session at Yale to address instruc- 
tional and other issues that arise during implemen- 
tation. At the end of the first year of implementa- 
tion, principals may attend a Principals’ Academy 
at Yale. The developers also offer an academy for 
teachers on child development. 

Subsequent professional development activities 
are based on the training needs associated with 
the schools Comprehensive School Plan, as de- 
termined by the School Management and Plan- 
ning Team. School Development Program staff 
train local facilitators to provide professional de- 
velopment at the school. 

School Development Program staff visit schools 
twice each year to assess how well the approach is 
being implemented, facilitate district meetings, and 
provide guidance and training. Member schools 
receive quarterly newsletters and have access to a 
Web site. In addition, the approach offers other 
professional development activities, including sat- 
ellite broadcasts, desktop videoconferencing, and 
regional training activities. 

Implementation Requirements and Schools’ Ex- 
periences. No formal vote is required for schools 
to adopt the School Development Program; how- 
ever, it is expected that both school and district 
personnel have committed to the program after 
extensive discussion and examination. In addi- 



tion, the School Development Program currently 
is accepting new members only in school districts 
that either already have or promise to have a siz- 
able number of schools using the approach and 
have a commitment from the superintendent, 
board of education, and teachers union. The de- 
velopers provide an implementation checklist to 
guide schools’ implementation. 

Several studies have identified factors that ben- 
efit the implementation of the School Develop- 
ment Program. First, the commitment of the 
principal has been shown to be essential to the 
successful implementation of the approach. Also, 
districtwide implementation has proven to be 
helpful for a number of reasons, including: (1) 
reducing competition between School Develop- 
ment Schools and non-School Development 
Schools in a district; (2) increasing the opportu- 
nities for networking among teachers; (3) broad- 
ening the community of parents; and (4) ensur- 
ing central-office support. 

Some of the components of this approach are 
apparently quite difficult to implement. One 
study found that it was difficult to achieve the 
desired level of parent participation. Some schools 
have found that parents for whom English is a 
second language were hesitant to become involved 
because they had a hard time following the meet- 
ings. Another study found that it was difficult to 
get all staff on board — there was a tendency for 
the same group of teachers and parents to be in- 
volved with the process, while another group 
never became involved. Yet, regardless of these 
challenges, many schools have implemented the 
School Development Program successfully over 
a long period of time. 

Researchers also have shown that students in 
schools using the School Development Program 
had significantly larger gains in various measures 
of self-concept over time. One study found sig- 
nificant differences on six different dimensions 
of self-concept: behavior, intellectual and school 
status, physical well-being, anxiety, popularity, 
and happiness and satisfaction. Another study 
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found significant differences only on the intel- 
lectual and school status dimensions. 

COSTS 

The first-year cost of adopting the School De- 
velopment Program is $45,000. This includes 
workshops for five teachers and the principal, in- 
cluding release time; technical assistance; a fee to 
the developer; and the salary for a quarter-time 
facilitator. Schools can lower this cost to $32,000 
by reassigning a current staff member to serve as 
the facilitator. 

Districts participating in the School Development 
Program pay an administrative fee of $5,000 per 
year to join. Schools can send staff to the Yale week- 
long workshops for $1,000 per person for each 
workshop. (Developers estimate approximately five 
teachers per school attend two workshops.) The 
principal’s academy costs $1,000. School Devel- 
opment Program staff generally make two visits 
to the school each year for technical assistance, at 



$ 1 ,000 per visit plus travel expenses. The program 
recommends that districts budget for a full-time 
program facilitator, bur notes that schools should 
be able to operate with a quarter-time facilitator. 
Additional expenses include staff release time and 
professional development. 



CONTACT INFORMATION 

Dr. Joanne Corbin 
Director of Operations 
School Development Program 
53 College Street 
New Haven, CT 06510 
Phone: 203-737-1020 
Fax: 203-737-1023 

E-mail: corbinjn@maspo3.mas.yale.edu 

Web site: http://www.info.med.yale.edu/ 
comer 
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Success for All 



Evidence of positive effects on student achievement 


• 


Year introduced in schools 


1987 


Number of schools 


1,130 


Support developer provides schools 


• 


First-year costs 




with new staff 


$270,000 


with current staff reassigned 


$70,000 


0 = Strong 3 = Promising (i = Marginal O = 
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OVERVIEW 

Success for All is a comprehensive approach to re- 
structuring schools, especially those serving stu- 
dents placed at risk, to ensure that every child learns 
how to read. The approach has nine components: 

• a reading curriculum designed to provide at 
least 90 minutes of daily instruction in classes 
regrouped across age lines according to read- 
ing performance; 

• continual assessment of student progress (at 
least once every eight weeks); 

• one-to-one reading tutors; 

• an Early Learning Program for prekinder- 
garten and kindergarten that emphasizes lan- 
guage development and reading; 



• an emphasis on cooperative learning as a key 
teaching strategy; 

• a family support team to encourage parent 
support and involvement as well as to address 
problems at home; 

• a local facilitator to provide mentoring, coun- 
seling, and support to the school as needed; 

• staff support teams that assist teachers dur- 
ing the implementation process; and 

• training and technical assistance provided by 
Success for All staff on such topics as reading 
assessment, classroom management, and co- 
operative learning. 

The main goal of Success for All is to ensure suc- 
cess in reading. Secondary goals include reduc- 
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ing the number of referrals to special education, 
reducing the number of students who are retained 
or “held back,” increasing daily attendance, and 
addressing family needs. 

The Success for All approach was developed by 
Robert Slavin and Nancy Madden at Johns 
Hopkins University. They designed Success for 
All in response to a challenge from Baltimore City 
Public Schools to develop an approach that would 
address the problems of urban students, based 
on research about effective instructional practice. 
They established the first Success for All school 
in 1987. Since then. Success for All (and its com- 
panion approach. Roots and Wings) has been 
adopted by over 1,130 pre-K-6 schools (nearly 
all Title 1) in 44 states. The approach has also 
been adapted for use in Canada, Mexico, Aus- 
tralia, Israel, and England. Although still geared 
primarily to urban environments, the approach 
is also used by many schools in rural and subur- 
ban settings. The developers plan to add another 
400 to 600 schools per year. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. The research on 
Success for All is strong, based on its size and 
consistency of findings. Sixteen empirical stud- 
ies, detailing information from about two dozen 
different sites, were available for review; all but 
one used sufficiently rigorous methodologies to 
be reported here. Most studies use a “matched 
control” technique, in which researchers compare 
Success for All students with similar students in 
similar schools. Of the 16 studies reviewed, eight 
were either authoied or co-authored by the de- 
velopers. Eleven studies also provide information 
on implementation. 

Effects on Students. Compared to control 
schools, including schools using other ap- 
proaches that employ one-on-one tutors. Suc- 
cess for All schools show significant improve- 
ments in students’ reading performance on stan- 
dardized tests (e.g.. Comprehensive Test of Ba- 



sic Skills, Woodcock Reading Mastery Tests, and 
the Durrell Analysis of Reading Difficulty) and 
other measures. For example, one study showed 
that Success for All students were achieving at a 
level of three to eight months ahead of com- 
parison students. Another study showed that 
Success for All students passed the state func- 
tional exam at higher rates than comparison stu- 
dents. Not only does the research on Success 
for All show statistically and educationally sig- 
nificant improvement in student scores, but it 
does so consistently across the studies reviewed. 
The approach has the greatest effect on students 
who are at risk of school failure (i.e., students 
scoring in the lowest 25 percent on the pre-test, 
students in ESL programs and in bilingual pro- 
grams using the Spanish version of the Success 
for All curriculum, and minority students). 

For all students, the size of reading improvement 
varies according to level of program implemen- 
tation. For instance, schools not implementing 
the eight-week assessments or not providing ad- 
equate tutoring do not show as large an effect as 
schools providing all services. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. Schools may need to make ex- 
tensive changes to implement Success for All suc- 
cessfully. The first change may be additional staff; 
schools must have a full-time facilitator to help 
implement the program, and may need to hire 
additional teachers or paraprofessionals for the 
required one-on-one tutorials for struggling stu- 
dents. The facilitator is a certified teacher (gen- 
erally paid for using Title 1 funds) who coordi- 
nates staff implementation of the program. In 
addition to working with staff by visiting class- 
rooms, coaching, and conducting ongoing pro- 
fessional development, the facilitator supervises 
the eight-week assessments and serves as liaison 
among teachers, administrators, tutors, family 
support staff, and parents. According to the de- 
velopers, few Success for All schools hire addi- 
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tional staff; most reallocate current staff to fill 
required roles. 

Second, reading classes may have to be restruc- 
tured to meet the requirements of the approach. 
Success for All requires 90 minutes per day of 
reading instruction targeted to classes grouped 
by reading level beginning in grade one. Group- 
ing is revised every eight weeks based on indi- 
vidual assessments of students’ reading skills. 

Third, with regard to special education and re- 
tention, Success for All encourages schools not 
to refer children for special education services and 
not to retain children in grade. Instead, as dis- 
cussed below, the program is designed to sup- 
port all children’s learning in general education 
classrooms. When considering adoption of Suc- 
cess for All, a district may need to consider its 
policies on one or both of these issues. 

Curriculum and Instruction. Success for All 
uses a highly structured curriculum focused on 
reading and English language arts. (Its sister ap- 
proach, Roots and Wings, expands into other 
subject areas.) 

The Early Learning Program, for prekindergarten 
and kindergarten, focuses on developing oral lan- 
guage skills using developer-provided materials. 
In the Early Learning Program students listen to, 
retell, and act out stories. In mid-kindergarten 
or first grade, students begin Reading Roots, a 
beginning reading program in which students 
work with controlled-vocabulary mini-books and 
repeated oral reading. Reading Roots involves a 
blend of phonics and “whole language” tech- 
niques and uses children’s literature and student 
text supplemented by teacher-read text. Pre- 
kindergarten through first-grade students almost 
exclusively use materials provided by the 
developer. 

In grades two through six, students work with 
another program, Reading Wings, which uses a 
wide range of commonly available basals, an- 
thologies, and novels. The developer requires 
teachers to use specific strategies in Reading 



Wings, in which students read stories to each 
other and discuss content and structure, as well 
as participate in activities on listening compre- 
hension, vocabulary building, reading fluency, 
and writing. According to the developer, the read- 
ing lessons are fast-paced, with a variety of ac- 
tivities in each lesson, and an emphasis on stu- 
dents learning in cooperative activities. 

A Spanish version of the reading curriculum, Lee 
Conmigo or Exito Para Todos, is available for 
students in bilingual and English-as-a-Second- 
Language programs. 

In addition to the writing activities that are part 
of the reading curriculum, the developer provides 
a curriculum that focuses on writing. Grades one 
and two use Writing from the Heart, in which 
students are introduced to the writing process 
(e.g., write for a real audience, revise, and build 
skills in the context of writing). Grades three 
through six use Writing Wings, in which teams 
of four to five students of different skill levels 
work together. Students write individual drafts 
that they critique and revise together. 

Finally, Success for All includes an extensive tu- 
toring program in grades one through three. Stu- 
dents having difficulty learning to read receive 
tutoring from certified teachers or other quali- 
fied and trained instructional staff. In assigning 
students to tutors. Success for All gives priority 
to students in first grade. 

Supplies and Materials. Although teachers may 
adapt materials, the developer requires schools 
to work with the Success for All materials in 
prekindergarten through first grade. For grades 
two through six, the developer provides materi- 
als, called “Treasure Hunts,” tailored to the read- 
ing materials already used in the school. Treasure 
Hunts have been developed to accompany the 
most widely used basal readers, anthologies, and 
novels. All new materials are sent to teachers in 
Success for All schools for review, and are then 
piloted in Success for All classrooms before be- 
ing distributed. 
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Finally, the developer requires schools to have an 
adequate number of books and other materials 
to accompany the various components of the 
approach (e.g., space and supplies for the facili- 
tator, books given as resources to parents, and 
materials such as books, paper, and pencils to be 
used during one-on-one tutoring). 

Scheduling and Grouping. Success for All re- 
quires schools to organize students by reading per- 
formance level into multi-age groups of approxi- 
mately 20 students for at least 90 minutes per 
day for reading instruction. For the rest of the 
day, students are in heterogeneous, age-grouped 
homerooms. 

According to the developers, the approach is geared 
to helping all students learn to read in the regular 
classroom. The developers’ materials suggest that 
helping students learn to read should vastly reduce 
the need for placement in special education classes. 
One of the tenets of Success for All is that chil- 
dren should be removed from the regular class- 
room only under extreme circumstances and when 
all other options have been exhausted. 

Monitoring of Student Progress and Perfor- 
mance. Success for All requires formal assessments 
of student progress at least every eight weeks. 
These assessments are embedded in the curricu- 
lum. The results are used to reevaluate reading 
grouping and change student assignments if 
needed. Because Success for All attempts to pro- 
vide reading instruction tailored to the specific 
level of each student, accurately assessing students 
and placing them into the appropriate reading 
group is important. 

In addition to formal assessments, ongoing infor- 
mal assessments of progress are also encouraged. 
These informal assessments also help to tailor in- 
struction to the specific level of the students. 

These regular reading assessments also help to 
identify students who are struggling before they 
fall far behind. These students receive one-on- 
one tutoring for 20 minutes per day at times other 



than regular reading or mathematics periods. 
First-grade students get priority for tutoring. 

Family and Community Involvement. Parent 
support is critical to the Success for All approach. 
Each Success for All school has a “family support 
team” to increase family involvement. The goal 
of these teams is to encourage parents to read to 
students, to involve parents in school, and to help 
families address any problems at home that af- 
fect a student’s ability to learn in school (e.g., by 
providing referrals to social services). Teams typi- 
cally include an administrator (principal or as- 
sistant principal), the Success for All facilitator, 
and others such as social workers, counselors, 
attendance monitors, teachers, and volunteers. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. Professional development and technical 
assistance for Success for All schools are provided 
by trainers (members of the developer’s staff) and 
the program facilitators at each school. Trainers 
typically are former teachers, principals, or fa- 
cilitators in Success for All schools. 

In the spring before implementing Success for 
All, the principal and facilitator attend a week- 
long training session. Late in the summer of that 
year. Success for All staff visit the school to pro- 
vide a three-day inservice for all staff that intro- 
duces them to each component the school is 
implementing. 

During the first year, the developer provides sev- 
eral days of follow-up with the principal, facili- 
tator, and instructional staff This strpport in- 
cludes three two-day follow-up visits (also known 
as “implementation visits”) that focus on imple- 
mentation of the curriculum, plus two one-day 
visits that focus on the family support team. The 
developer uses an implementation visit record 
form, which can be used by the schools between 
visits to track implementation progress. 
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Every spring, the developer provides regional con- 
ferences for experienced schools. The principal 
and facilitator are expected to attend; many teach- 
ers also choose to participate. 

The developer provides full technical assistance 
services for three years at minimum (including 
site visits, consulting over the telephone, and ac- 
cess to materials and a Web site). After the third 
year, developer support for professional develop- 
ment continues at a lower level. However, the 
facilitator remains at the school to guide the ap- 
proach, and may continue to call the developer 
with questions. 

Implementation Requirements and Schools’ Ex- 
periences. Prior to implementation, the devel- 
oper of Success for All requires the following: 

• District and school staff are encouraged to 
examine Success for All materials and visit 
Success for All schools to become familiar 
with the approach. 

• A secret ballot must be taken, in which at 
least 80 percent of school staff vote to adopt 
the approach. 

• A full-time facilitator must be provided. 

• At least one certified teacher tutor and three 
other tutors must be provided. 

• Staff for the Family Support Team must be 
provided. 

According to the research on implementation, 
the cost and time requirement of the approach 
are difficult for some schools to manage. Most 
studies found that all components were imple- 
mented, but some more comprehensively than 
others. For example, some schools found it dif- 
ficult to fund and manage the large number of 
tutors and other additional personnel (family 
support personnel, counselors, etc.). Conse- 
quently, after a few years, some schools opted 
to scale down the approach. Some schools have 
significantly decreased or even eliminated the 
family support and the one-on-one tutoring 
components of the approach — which the devel- 



oper believes are crucial. In addition, many 
schools have discontinued or scaled back the 
required eight-week assessments — another cru- 
cial aspect of the approach, according to the 
developer. Not only replication sites but also 
several of the original sites in Baltimore have 
engaged in this scaling back or eliminating of 
components. 

COSTS 

The first-year cost of adopting Success for All is 
$270,000. This covers professional development, 
including teacher release time; materials; and sala- 
ries for a full-time facilitator and three tutors. 
However, schools can reduce the cost to $70,000 
by reassigning current staff to serve as the facili- 
tator and reading tutors. 

Costs depend on the size and location of schools 
and the number of schools that share training 
and travel expenses. As an example, the devel- 
opers estimated base costs for a school of 500 
students are as follows: $70,000 for year one, 
$30,000 for year two, and $20,000 for year three 
and later years. Additional costs not included in 
this estimate are staff such as the full-time facili- 
tator and at least three tutors (according to the 
developer, these staff are generally reallocated 
from existing positions); costs for substitutes and 
release time for training, and costs for develop- 
ing and organizing a family support team. 

If staff are hired rather than reassigned from ex- 
isting positions, the figure rises substantially. In 
one cost comparison, the estimated yearly per- 
sonnel costs for a Success for All school with 500 
students range from $195,000 to $530,000 per 
year. The low estimate includes a facilitator, two 
reading tutors, a parent liaison, and a half-time 
social worker. The high estimate includes a fa- 
cilitator, six reading tutors, a parent liaison, two 
social workers, a counselor, and a half-time at- 
tendance monitor. Adding personnel costs to 
training costs— one low estimate is $66,060 — 
provides an estimated range of $261,060 to 
$646,500, depending on the number.of person- 
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neL As most of the cost is associated with addi- 
tional personnel, it should be assumed not to vary 
widely from the first year to subsequent years. 

Another study estimates first-year costs to range 
from $160,500 to $340,500. In part, the differ- 
ence between the figures in the two studies is due 
to the fact that one study assumed the use of para- 
professionals as aides and the other assumed the 
use of certified teachers. 



CONTACT INFORMATION 

Dr. Robert Slavin 

Success for All Foundation 

200 W. Towsontown Boulevard 

Baltimore, MD 21204 

Phone: 800-548-4998 

Fax: 410-324-4444 

E-mail: info@successforall.net 

Web site: http://www.successforall.net 
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Talent Development 
High School with 
Career Academies 



Evidence of positive effects on student achievement 




Year introduced in schools 


1994 


Number of schools 


10 


Support developer provides schools 


• 


First-year costs 




with new staff 


$57,000 


with current staff reassigned 


$27,000 
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OVERVIEW 

The Talent Development High School divides 
large, urban high schools into smaller units 
(“academies”), including a Ninth Grade Success 
Academy and academies based on career themes 
for students in the upper grades. The approach 
aims to reorganize students and teachers in the 
school and to change instruction to focus on stu- 
dents’ academic needs and career interests. The 
developer specifies the structure of the changes 
and provides guidance and some curriculum 
materials; the school staff is expected to deter- 
mine the specific themes for reorganization and 
to revise curricula and instruction accordingly. 

The primary goal for the Talent Development 
High School is to improve achievement and other 
outcomes (e.g., attendance, dropout rates) for all 







students in large high schools by creating a per- 
sonalized environment that focuses on students’ 
interests within an academic core of courses. 

Research on dropouts influenced the design of the 
approach. This research indicates that students 
drop out of school for four reasons: anonymity or 
social estrangement; apathy or lack of purpose; fail- 
ure, especially in ninth grade; and personal prob- 
lems such as drugs or pregnancy. To address these 
problems, the Talent Development approach 
breaks the school into small units with a career 
focus, provides extra help to failing students, and 
provides an alternative school and counseling to 
help students with personal problems. 

The Talent Development approach was devel- 
oped by the Center for Research on Students 
Placed at Risk (CRESPAR) at Johns Hopkins 
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University. The first Talent Development High 
School was planned during the 1994-95 school 
year and implemented in the 1 995-96 school year. 
In fall 1998, 10 schools were using the model, 
mostly in Baltimore and Philadelphia. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. This is a relatively 
new approach, and the research base is still mar- 
ginal. Only one rigorous study on the student 
achievement effects of the approach was avail- 
able for review. This study, conducted by the de- 
veloper, measured results in the first Talent De- 
velopment High School. The same study also 
provides implementation data for this pilot site. 

Effects on Students. The one study examining 
effects on students shows encouraging results for 
achievement and attendance. Compared to other 
schools in the district, the Talent Development 
High School showed greater improvement over 
two years as measured by the proportion of stu- 
dents passing the Maryland Functional Exams. The 
improvement was substantial in mathematics, but 
small in reading and writing. The percentage of 
students who were retained in grade also dropped 
substantially since the school began using the Tal- 
ent Development model in 1995. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. The developer requires schools 
to establish a Ninth Grade Success Academy and 
several Career Academies for grades ten through 
12. Each academy is self-contained, with its own 
faculty, management team, section of the build- 
ing, and entrance. The Ninth Grade Academy is 
further divided into interdisciplinary teams of 
four teachers from different content areas, with a 
maximum of 150 to 180 students per team. 
Schools typically have from two to six Career 
Academies, with a maximum of 300 to 350 stu- 
dents in each academy. 



Talent Development High Schools are required 
to appoint an assistant principal and a teacher 
leader as the management team for each acad- 
emy. Schools also must have one half-time orga- 
nizational facilitator in the planning year, and two 
half-time facilitators in the next two implemen- 
tation years. If the developer determines that an 
organizational facilitator is still needed after the 
initial year, the second facilitator will be an in- 
structional facilitator for the highest-priority aca- 
demic area (English or math). If an organizational 
facilitator is no longer required, the school will 
have two instructional facilitators, one in English 
and one in math. After the second implementa- 
tion year, the developer expects that the school 
will have built enough internal capacity to no 
longer need the instructional facilitators. 

Curriculum and Instruction. Each academy of- 
fers the same core academic courses (i.e., English, 
mathematics, science, and history) so that stu- 
dents in any academy will meet college entrance 
requirements. Core courses use readings and as- 
signments that reflect the academy theme. The 
faculty of each career academy selects topics and 
develops curricula for elective courses and intern- 
ships that are consistent with the academy theme. 
An advisory board of potential employers guides 
this process. 

The developer has produced two curriculum 
packages for English: Student Team Literacy and 
Student Team Writing. Both involve coopera- 
tive learning instructional strategies. There are 
two other curricula: Transition to Advanced 
Math, designed to teach students with weak 
mathematics backgrounds the basic skills re- 
quired to take algebra; and the Freshman Semi- 
nar, designed to develop social skills, study skills, 
and career awareness. 

According to the developer. Talent Development 
also provides students with “recovery chances” — 
opportunities outside of the regular school day to 
rhake up courses they have failed. Ninth-grade stu- 
dents working below grade level are required to 
take twice the normal course load in English and 
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mathematics, spending 90 minutes a day in each 
subject. The extra course work replaces electives, 
such as physical education and art. Students work- 
ing below grade level also have access to coaching 
classes before or after school, peer tutoring, com- 
puter drills, summer school, Saturday school, and 
evening school for academic credit. 

An alternative after-hours program, the Twilight 
School, is conducted in the building for students 
who have serious attendance or discipline prob- 
lems (including students recently released from 
prison or suspended from another school). In- 
struction is offered in small classes in the basic 
subjects, and extensive services are provided by 
guidance and support staff The developer esti- 
mates that in a school of 2,000 students, the 
Twilight School would involve four teachers and 
120 students. 

Students who are working above grade level have 
access to advanced courses, televised courses of- 
fered at other locations, courses at local commu- 
nity colleges, and internships. 

Supplies and Materials. The developer requires 
schools to use its curricula (described above) and 
to use the Talent Development guidebooks dur- 
ing the planning year. No other specific materi- 
als or supplies are provided or required. 

Scheduling and Grouping. Students and staff 
are grouped into several Career Academies. Each 
academy organizes its own schedule, within the 
structure of a four-period day. To help students 
choose the Career Academy they wish to join in 
tenth grade, students in ninth grade complete 
an inventory of their interests (the Holland 
Career Interest Inventory). Upper-grade stu- 
dents take most of their classes within their acad- 
emy; on rare occasions, a student may choose 
to take an elective class in another academy that 
is not offered in the student’s home academy. 
Each academy enrolls students of different 
achievement levels. 

Instructional staff within each academy are re- 
quired to have a common planning period. Stu- 



dents stay with the same homeroom advisory 
teacher for grades ten through 12. 

Monitoring Student Progress and Performance. 
The developer encourages schools to assess stu- 
dent progress using district test scores; weekly 
attendance by class, grade, and academy; and stu- 
dent and teacher surveys. Teachers within a sub- 
ject are required to use common midterm and 
final exams to ensure that students in different 
academies are held to the same standards. Talent 
Development High Schools are expected to use 
a modified report card that shows a students 
improvement as well as achievement. 

Family and Community Involvement. The de- 
veloper emphasizes family involvement as an 
important part of the Talent Development ap- 
proach. The Talent Development High School 
uses the Epstein six-fold parent/school partner- 
ship approach, which teaches a team of teachers, 
administrators, and community members six 
strategies to involve parents (e.g., sending infor- 
mation home, assigning homework that involves 
parents, asking parents to volunteer at the school). 
The team chooses one of these strategies to in- 
volve parents, and then plans and carries it out. 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical Assis- 
tance. During the planning year, all staff mem- 
bers participate in professional development ac- 
tivities at the school for two hours every other 
week. School staff members progress through an 
academy formation process that involves acad- 
emy development, faculty selection, marketing, 
student selection, pathway development, facility 
changes, and scheduling. Ninth-grade teachers 
are trained to work together as a team. All teach- 
ers participate in professional development on 
how to teach using an extended course period 
(e.g., strategies such as small-group instruction). 
As part of their professional development, teach- 
ers reorganize the traditional 18-week course se- 
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quence to fit into the new four-period day. The 
developer also provides monthly professional 
development sessions in which teachers learn new 
methods to teach specific subjects. 

During the summer between the planning year 
and the first implementation year, the developer 
provides professional development for school 
staff, including: 

• how to work as a team (three days for Ninth 
Grade Academy, all staff); 

• leadership training (three days for Academy 
leaders and principals); 

• training in the Student Team Literacy and 
Student Team Writing curricula (three days 
for Ninth Grade Academy English/ reading 
teachers); 

• training in the Transition to Advanced Math 
curriculum (three days for Ninth Grade Acad- 
emy mathematics teachers); 

• training in the curriculum for Freshman 
Seminar (one day for the Ninth Grade 
Academy); 

• how to make teaching and learning active for 
a 90-minute period (two days for all staff). 

After the planning year, professional development 
increases to two hours every week, and training 
focuses on using new curriculum units provided 
by the developer. The facilitator checks with 
ninth-grade teachers once a month on their use 
of the English/ reading and mathematics curricula. 
Teachers coach each other in the areas specified 
in the school professional development plan (e.g., 
technology, active instruction, and using the ex- 
tended period). 

The developer requires Talent Development 
schools to use facilitators as they plan and imple- 
ment the approach, as described above. Facili- 
tators are experienced teachers, trained by the 
developer, who have taken one or two years of 
leave to help implement the approach. In the 
planning year, the organizational facilitator 



guides program planning (i.e., developing a 
steering committee to form academies, divid- 
ing the school building into different academies, 
and establishing a four-period day). In the 
implementation years, developer staff and in- 
structional facilitators in English and math pro- 
vide ongoing coaching and guidance as school 
staff reorganize the school and the math, sci- 
ence, history, and language arts curricula. 

Implementation and Requirements and Schools’ 
Experiences. Schools must meet a set of goals 
and a timeline for each stage of implementation, 
including staff awareness, application process, 
planning year, and first implementation year. For 
the application, the developer strongly recom- 
mends that a member of the Talent Development 
staff present the program to school staff, parents, 
and community members, and that all those in- 
volved review materials on the program. Schools 
are required to complete an application process, 
which includes an 80 percent vote of approval 
from staff, before planning the local design. 

Once a school decides to use the Talent Devel- 
opment approach, it spends one year in a plan- 
ning phase. The school is required to establish a 
steering committee of teachers, leaders, and prin- 
cipals that reviews proposals and selects themes 
for Career Academies (based on the interests and 
qualifications of teachers, job opportunities, and 
coverage of broad career categories). Each fac- 
ulty member selects the academy he or she would 
like to join. The school principal then selects a 
management team for each academy, consisting 
of an Academy Principal and an Academy In- 
structional Leader, who then markets the model 
through brochures and presentations. Each stu- 
dent may select the academy of choice, guided 
by the Holland Career Interest Inventory and 
presentations by academy teachers. 

During the summer between the planning and 
first implementation years, schools revise their 
schedules to a four-period day. Before school 
opens after the first implementation year, the 
physical layout of the school is reorganized: sepa- 
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rate entrances for each academy must be built or 
assigned, and teachers in the same academy move 
to a common area in the building. The Twilight 
School, summer, and Saturday school programs 
are established. 

The developer recommends that schools take 
three years to implement the approach (one plan- 
ning year and two implementation years). The 
first areas of focus are reorganizing the school into 
academies, improving student attendance, and 
providing assistance to struggling students to 
ensure they are promoted to the next grade. Next, 
schools focus on instruction; at this stage, teach- 
ers attend professional development on instruc- 
tional strategies, and principals plan to acquire 
necessary resources (e.g., computers, textbooks, 
additional staff). 

The developer evaluates the schools implemen- 
tation of the approach with spring surveys of stu- 
dents and staff, periodic interviews with a sample 
of staff and students, and progress reports from 
principals, academy leaders, and teachers. 

Based on the limited research conducted to date, 
there is adequate implementation support for 
the Talent Development High School. In the 
first pilot school, the approach was implemented 
at the developers intended and expected time 
schedule. Because implementation research was 
only available for the first Talent Development 
school, it is impossible to judge how easy it will 
be to replicate the approach in additional 
schools. 

COSTS 

The first-year cost for a school of 500 students 
to adopt Talent Development High School is 
$57,000. This cost covers professional develop- 
ment, including teacher release time and sti- 
pends; materials; building renovations; discre- 
tionary funds; and additional staff However, 
schools can reduce this cost to $27,000 by reas- 
signing current staff to fill the role of the half- 
time organizational facilitators. 



The developer estimates costs for a school of 
2,000 students (or four times the first-year esti- 
mate given above) because the approach was de- 
veloped for large high schools. 

In the planning year, the developer reports, the 
Talent Development school could expect to 
spend $52, 1 00 plus release time for professional 
development and facility changes. This sum in- 
cludes $41,000 paid to the developer to cover a 
half-time organizational facilitator ($30,000); 
ten days of expert consulting, including travel 
($10,000); and guidebooks for each teacher for 
the planning year ($1,000). The school would 
spend the remaining $1 1,100 on: brochures to 
market the academies ($2,500 for five acad- 
emies); Holland Career Interest Inventories for 
all students except seniors ($3,600); facility ad- 
aptations and academy signs (estimated at 
$5,000); and $2,000 to $5,000 in discretion- 
ary funds for unplanned expenses. Finally, 
schools must cover professional development 
time (four hours per month, per teacher for nine 
months). 

In the summer, between the planning and first 
implementation year, the school should expect 
to spend $47,130 for professional development 
(also included in the cost estimate for the first 
year). Of that sum, $9,850 would be paid to 
the developer to cover trainers, travel, and ma- 
terials. The remaining $37,280 would be spent 
by the school on stipends, food, a.nd the train- 
ing facility. 

After the planning year, the 2,000-student high 
schools should expect to spend $76,500 per year, 
for two years. Of that total, $72,400 goes to 
the developer for: two half-time facilitators 
($30,000 each); monthly visits and weekly 
phone calls by a consultant to help teachers use 
the literature curriculum ($6,000) and the math- 
ematics curriculum ($6,000); and materials for 
a leadership meeting and ninth-grade attendance 
workshop ($400). The remaining $4,100 would 
be spent by the school on brochures for acad- 
emies ($2,500) and Holland inventories 
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($1,600). During the implementation period, 
schools also should expect to pay for any addi- 
tional professional development and additional 
renovations to the building (e.g., creating new 
entrances) as needed, in addition to expenses 
for the Twilight School. 

These costs do not include time during the school 
year for teachers to plan changes in curriculum 
and instruction. The developer estimates between 
20 and 40 hours per teacher per year. In addi- 
tion, schools are encouraged to create science 
laboratories in the Ninth Grade Academy sec- 
tion of the building, install a public address sys- 
tem for each academy, and provide discretionary 
jfunds for each academy ($2,000 to $5,000 in the 
planning year and $5,000 to $10,000 for the first 
implementation year). 



CONTACT INFORMATION 

Dr. James M. McPartland, Codirector 
Talent Development High School Program 

Center for Research on Students Placed at 
Risk 

Johns Hopkins University 

3003 North Charles Street, Suite 200 

Baltimore, MD 21218 

Phone: 410-516-8800 

Fax: 410-516-8890 

E-mail: jmcpartlan@csos.jhu.edu 

Web site: http://scov.csos.jhu.edu/talent/ 
talent.html 
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Evidence of positive effects on student achievement 


? 


Year introduced in schools 


1993 


Number of schools 


13 


Support developer provides schools 


3 


First-year costs 




with new staff 


$169,000 


with current staff reassigned 


$159,000 


® = Strong = Promising (i = Marginal 0 = 


Mixed, Weak ?= No Research 



OVERVIEW 

The goal of the Urban Learning Centers approach 
is to provide an academically rigorous curricu- 
lum that connects across grade levels and is sup- 
ported by parents and the community. The ap- 
proach can be broken, down into three parts: 

• teaching and learning; 

• governance and management; and 

• learning supports. 

The approach attempts to improve student learn- 
ing, meet the learning needs of students who are 
at risk of school failure, restructure school orga- 
nization, increase family and community involve- 
ment, increase access to non-academic services, 
improve school climate, redefine relations among 



teachers and others, and expand the roles of class- 
room teachers. 

Urban Learning Centers is one of several ap- 
proaches sponsored by New American Schools, 
a national initiative to develop replicable school- 
wide reform programs. It is a collaboration of 
the Los Angeles Unified School District, United 
Teachers of Los Angeles, and the Los Angeles 
Educational Partnership. The approach started 
in Los Angeles with two centers — Elizabeth Street 
in July 1993 and Foshay in July 1994. Two addi- 
tional schools began implementing the approach 
in 1996. As of January 1998, the approach was 
being used in 13 urban schools in California, with 
more than one learning center at the larger (K-12) 
schools. Urban Learning Centers encompass 
grades from pre-kindergarten to 12. The devel- 
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oper intends to add 30 to 40 new centers in 
1998-99 and maintain this rate of growth over 
the next three to five years. 

EVIDENCE OF POSITIVE EFFECTS 
ON STUDENT ACHIEVEMENT 

Strength of the Research Base. Urban Learning 
Centers is a relatively new approach, and no rig- 
orous studies on student achievement are yet 
available. Although four publicly available stud- 
ies report data on student outcomes, they do not 
use sufficiently rigorous methodologies to be in- 
cluded here. However, the developer collects and 
makes publicly available test score data on Ur- 
ban Learning Centers. 

No research was available about replication of the 
model in diverse sites. Although the developer 
states that the approach is appropriate for all types 
of students at all types of schools, the research 
only reports on urban, Los Angeles schools with 
high proportions of students at risk of failure. 
Three studies provide information about the 
implementation of this approach. 

Effects on Students. At the time of this report, 
there are no studies of sufficient rigor upon which 
to base conclusions about the effects of Urban 
Learning Centers on student achievement. 

CENTRAL COMPONENTS 

Organizational Change, Staffing, and Admin- 
istrative Support. The Urban Learning Centers 
approach requires changes in school organization 
to address three areas: teaching and learning, gov- 
ernance and management, and learning supports. 
According to the developer, the approach can ac- 
commodate other reforms also underway in the 
school. 

The developer also claims that the Urban Learn- 
ing Centers approach facilitates a curriculum and 
school environment that develops connections 
among subject areas and across grade levels. This 
includes multi-age classrooms; multi-year teach- 



ing assignments; articulation across elementary, 
middle, and high school curricula; cross-age 
tutoring; and student peer-support systems. The 
developer recommends, but does not require, that 
schools extend learning time for students through 
after-school, Saturday, and intersession classes. 
Common planning time for teachers also is 
recommended. 

The Urban Learning Centers approach may 
require changing the governance and manage- 
ment of the school. The developer recommends 
a collaborative approach to governance and 
management and a decision-making process that 
includes parents, community members, school 
staff, teachers, and administrators. Despite this 
emphasis on local management, the developer 
indicates that the model can be instituted even 
in school systems with large bureaucracies, as 
evidenced by the two original Urban Learning 
Centers in the Los Angeles Unified School 
District. 

There are no specific staffing requirements at the 
school level. Several schools have at least one full- 
time and one half-time coordinator. The coordi- 
nators generally are current staff members who 
are reassigned. 

Curriculum and Instruction. The Urban Learn- 
ing Centers approach does not provide or require 
a specific curriculum. It does, however, encourage 
the development of a curriculum that is focused 
on literacy and students’ critical thinking skills in 
all subject areas. This curriculum, which should 
be in line with an approach providing consistency 
across grade levels, should be organized into the- 
matic and interdisciplinary units. The developer 
also indicates that the school staff should modify 
curricula to be consistent with district and state 
curriculum and performance standards. 

The developer encourages teachers to use a variety 
of instructional techniques (e.g., student-centered 
instruction, direct instruction). The developer 
also emphasizes that clear expectations should be 
set for students with regard to what they are 
supposed to know or be able to do (e.g., share 
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the grading criteria with them, show them 
examples of good products), and that teachers 
should strive to make learning an active exper- 
ience that engages student interest. 

Supplies and Materials. No specific materials are 
provided or required. The developer emphasizes 
technology as critical to the approach, however. 
The Urban Learning Centers environment at- 
tempts to create a strong link between the class- 
room and the world outside the classroom 
through the iise of technology. 

In addition, the developer notes that many Ur- 
ban Learning Centers make use of resources avail- 
able in the community (e.g., libraries, local mu- 
seums, local attractions, and local experts on dif- 
ferent topic areas), even though such resources 
are not explicitly provided. 

Scheduling and Grouping. The developer recom- 
mends that students be arranged in mixed-ability 
classes and that teams of teachers teach together 
and collaborate on instruction. The developer also 
recommends using a variety of scheduling and 
grouping formats, such as scheduling long blocks 
of time for instruction in several subjects, group- 
ing students of different ages together, and keep- 
ing students together for more than one year. 

Monitoring Student Progress and Performance. 
The developer encourages the use of traditional 
assessments (e.g., quizzes and tests), as well as 
collections of student work (e.g., writing samples 
and presentations). In addition, specific goals are 
stipulated in each of the three main component 
areas of the program (teaching and learning, gov- 
ernance and management, and learning sup- 
ports). For instance, on one component of teach- 
ing and learning — literacy — the expectations are 
that students: 

• read with fluency and comprehension; 

• flexibly change their reading style for differ- 
ent purposes; 

• are well-read across a variety of genres, at or 
above grade level; and 



• comprehend, analyze, and appreciate text and 
non-print media. 

There is also an emphasis on meeting state and 
local standards for student achievement. 

Family and Community Involvement. The 
developer assists schools in developing a variety 
of support strategies, including crisis assistance 
for families (e.g., family violence or drug abuse), 
support for transitions (e.g., information and sup- 
port for families as they enter the program), out- 
reach to the community, and any additional 
assistance needed by the student or family. 
Schools may select the most appropriate strategies 
for their situation, but are expected to establish a 
family and community center at the school for 
parent activities, child care, and access (e.g., 
referrals) to health and social services: 

Parent and community involvement is encour- 
aged, including using parents as community rep- 
resentatives, establishing extensive volunteer pro- 
grams, and providing adult education services 
(e.g., English as a Second Language, computer 
skills, and parenting skills). 

SUPPORT THE DEVELOPER 
PROVIDES SCHOOLS 

Professional Development and Technical 
Assistance. In the first year of implementing the 
approach, the developer provides professional 
development to both staff and parents on imple- 
menting the approach and networking with other 
schools. This may last for a single session or may 
be followed by additional training. Also in the 
first year, schools conduct a self-assessment to 
develop a long-term improvement plan. As a part 
of the self-assessment process, the developer 
provides a guide for schoolwide self-assessnicnt, 
thus allowing school staff to rate their strengths 
and weaknesses in each of three main areas: 
teaching and learning, governance and manage- 
ment, and learning supports. 

Professional development activities are then 
geared to meet the needs identified by the school 
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(e.g., setting goals, or collaborating with other 
schools in the same feeder pattern). The devel- 
oper provides workshops and seminars, and fa- 
cilitates peer coaching, visits to other schools/ 
classrooms, and participation in a network of 
teachers involved in the program. 

Finally, the developer assists schools in creating 
three key locations at the school or group of 
schools: 

• a Product Development Center, which is a 
center for multimedia technology designed 
to help students and teachers create projects 
for enhancing student literacy and learning 
and supporting the content standards; 

• a Family Center, including trained staff and 
technology tools, that coordinates student 
and family services; 

• a Teacher s Toolbox, which gives teachers ac- 
cess to electronic and print information and 
resources geared toward enhancing student 
projects and teacher-directed curricula. 

Implementation Requirements and Schools’ Ex- 
periences. Implementing the Urban Learning 
Centers approach does not require a formal vote 
of teachers, but does require that a leadership 
council of those who would be involved in the 
reform reach agreement. Subsequent to this con- 
sensus, the developer asks that the following steps 
be taken: 

• Present the idea to all faculty. 

• Work with the school board to establish a 
school-based governing team and design 
team. 

• With the project design team, complete a self- 
assessment of the three main areas of the pro- 
gram using the guidelines provided. 

• Establish goals and indicators of progress for 
the school. 

• Plan for integrating technology into the learn- 
ing environment and, if needed, acquiring 
additional technology. 



• Establish links to outside resources, such as 
social service agencies. 

• Make any necessary scheduling or grouping 
changes (e.g., extended year or extended 
hours, expansion of ages of children served, 
or multi-age grouping). 

• Within teacher-directed teams, plan and map 
out the specific curricula. 

The research on implementation focuses on the 
two original Urban Learning Centers. In both 
schools, most teachers supported the approach 
before implementation. However, some teachers 
were not prepared for, or interested in, assuming 
the nonteaching responsibilities central to the 
approach (e.g., sharing in school-level decisions). 

According to the research on a small sample of 
schools, the Urban Learning Centers approach 
is often implemented alongside other reforms. 
In some cases, the reforms seem consistent or 
complementary, sometimes to the point where 
teachers do not feel that they are using anything 
new; in other cases, the teachers appear over- 
whelmed by the effort to juggle multiple efforts. 

Although the developer emphasizes that schools 
set their own strategies for change using this ap- 
proach, and that the approach is unique in each 
school, there appear to be some commonalities. 
Both of the original Urban Learning Center 
schools used these strategies: instruction that in- 
tegrates more than one subject, scheduled in long 
blocks of time, with several teachers working to- 
gether; a focus on outcomes and use of portfo- 
lios of students’ work to assess progress; diverse 
instructional strategies such as hands-on learn- 
ing; more authority for school governance given 
to teachers, parents, and students; and support 
services, such as a family center, medical clinic, 
and referral process. 

According to the research, the first year was spent 
raising awareness of new teaching and organiza- 
tion strategies; the second year was spent experi- 
menting; and the third year was spent reflecting 
on and improving the use of these strategies. By 
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the end of the third year, schools were still ex- 
panding their use of these practices. However, 
neither school reached “full implementation” in 
which the entire school used these strategies. 

The professional development provided by the 
Urban Learning Centers is clearly of good qual- 
ity. According to the research and a small sample 
of sites, the trainers were knowledgeable and pro- 
fessional, and the Urban Learning Centers staff 
provided close guidance and technical assistance 
that was responsive to schools’ needs. However, 
in some cases, this responsiveness may have been 
counterproductive to effective reform. For ex- 
ample, one study suggests that schools’ profes- 
sional development selections were not always in 
the areas that needed the most improvement. 

According to research, major barriers to imple- 
menting the Urban Learning Centers approach 
were teacher resistance, inadequate time for plan- 
ning and training, inflexible daily and annual 
schedules at the school, difficulty with commu- 
nication among staff, and lack of accountability 
for following through on implementation. Ca- 
pacity to maintain the approach is an important 
issue; according to the developer, both of the 
model sites have reallocated funds to create staff 
positions to support implementation. However, 
one study indicated that a loss of funding caused 
a school to cancel a successful tutoring program 
and not provide some professional development. 

COSTS 

The first-year cost of adopting Urban Learning 
Centers is $169,000 for a school of 25 teachers. 
This cost covers professional development, in- 



cluding teacher release time, and additional staff 
However, schools can reduce this to $159,000 
by reassigning current staff to fill the role of the 
part-time coordinator. 

The developer estimates costs for a school of 50 
to 75 teachers, as this approach is targeted to- 
ward large, urban schools. Costs paid to the de- 
veloper are negotiable but average about $75,000 
per year for a school with 50 to 75 teachers (costs 
will vary by number of teachers). Included in this 
estimate are training and technical assistance, 
materials, and a part-time coordinator. 

Additional costs that are not included in the cost 
estimate are the optional full-time coordinator 
and release time for teachers for professional de- 
velopment and planning activities (e.g., more 
than 20 days of paid professional development 
were offered at Elizabeth Street Learning Cen- 
ter). In addition, there may be extra costs for tech- 
nology and other materials (e.g., a product de- 
velopment center). 



CONTACT INFORMATION 

Ms. Greta Pruitt or Ms. Judy Johnson 

Urban Learning Centers 

315 West 9th Street, Suite 1110 

Los Angeles, CA 90015 

Phone:213-622-5237 

Fax:213-629-5288 

Web site: http://www.lalc.K12.ca.us 
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Appendix A 

Criteria Used to Evaluate 
Evidence of Positive Effects 
ON Student Achievement 



The review of the research on the approaches^ effects on students was conducted in two stages. First, 
AIR collected all available studies that reported student achievement effects (e.g., test scores, grades, 
dropout rates, graduation rates) and critically reviewed them for methodological rigor. At this stage of the 
process, the research was rated based on important distinctions among studies, such as scope (e.g., number 
of students and schools, period over which data were collected), quality and objectivity of the measurement 
instruments, and affiliation of the researcher (i.e., did the researcher have a vested interest in the outcomes). 

Second, AIR assigned to each approach an overall rating for evidence of effects on student achievement, 
based on the number of studies that met the criteria for methodological rigor and the strength of the data 
showing positive student achievement effects reported in those studies. Because important methodological 
issues were addressed in the first stage, AIR did not consider the methodological rigor of individual 
studies in the second stage. 



Reviewing Studies for Methodological Rigor 

Review Process 

AIR made an extensive effort to gather and review all relevant material about each approach. Altogether, 
AIR reviewed over 130 student achievement studies, as well as numerous items that were not, ultimately, 
deemed appropriate for inclusion. ^ In a few instances, developers recommended additional studies late in 
the review process, after they read the first draft of, the profiles of their approaches. AIR attempted to 
acquire and review these materials. Fewer than five studies, identified very late in the process (i.e., the 
final two or three days of the project), were not included in the review. 

All studies that reported student achievement effects were reviewed and rated using an instrument 
developed for this type of research review and tailored to this project, the Evaluation of Research on 
Educational Approaches (EREA).2 

One of seven trained researchers reviewed each study individually using the EREA. The training 
process involved the researchers independently rating a sample study and collectively discussing the rationale 
behind their ratings. In areas where discrepancies occurred, standard processes were developed, recorded, 
and distributed to all researchers. 

Each researcher reviewed all of the studies for several reform approaches. Each researcher also reviewed 
a sample of studies being reviewed by fellow researchers. One out of every five studies was reviewed by 
two or more staff The overlapping studies were used to maintain inter-rater reliability. The project director 
compared ratings for these overlapping studies and, in cases of discrepancies, retrained the researchers 




and clarified the issues for all raters. For example, early reviews revealed different approaches to rating 
areas where information from the developers or studies reviewed was unclear. AIR developed a standard 
process, retrained researchers, and revisited ratings for all studies previously reviewed. 

Review Criteria 

Guided by the criteria in the EREA, we assigned each study a rating based on its overall methodology. 
The EREA contains a total of seven sections. The questions used to calculate the methodology rating are 
found in two sections (“levels”) of the EREA, Level 3 and Level 4. The other five sections capture information 
on implementation (Levels 1 and 2), or are used by the reviewer to summarize the findings from Level 3 and 
Level 4 (Levels 5, 6 and 7). 3 

Across Levels 3 and 4, each study was rated in 10 categories: 1) construct validity; 2) the higher of 
two ratings — internal validity or study design; 3) duration; 4) sample bias; 5) external validity; 6) statistical 
conclusions; 7) measures; 8) sample description; 9) and 10) study clarity (rated at both Levels 3 and 4). 
Each of the 10 categories carried equal weight, to a maximum of four points. The 10 individual ratings 
then were averaged to form a final methodology rating for the study; studies with an average rating of 
3.00 or above met the criteria for rigor. 

This approach was deliberately chosen to accommodate varied study designs by focusing on the overall 
methodology rather than a single critical element of methodology. For example, a highly quantitative 
analysis of test scores might provide a limited description of the sample studied, but compensate by 
including a very large number of subjects and using random assignment to a control group. A longitudinal 
case study might use a small sample, but compensate by collecting data over a long period of time and 
providing rich descriptions of the treatment and sample. The questions used to rate studies are described 
below. 

Level 3: Does the study satisfy minimal validity criteria? AIR assessed the degree to which each 
study satisfied minimal validity standards related to the following six categories: 

• Construct validity: Did the study focus on the construct (e.g., mathematics achievement) germane to 
the analysis? Did the study include measurable dependent variables? Did the dependent variable 
measure the construct under analysis? Did the study report the effects of the approach? If the answers 
to these questions were “yes,” the study earned the highest rating, four points. If one answer was “not 
clear,” the study earned three points. If there were multiple “not clear” responses, the study earned 
two points. If any of the questions were answered “no,” the study earned one point. Because AIR 
sought to review studies that reported measurable student achievement outcomes, very few studies 
did not earn four points in this area. 

• Internal validity: What research methodology was used to assess the approach (e.g., true experimental 
group design, case study, quantitative synthesis)? Was it cross-sectional or longitudinal? If the 
methodology was a true or quasi-experimental group design or quantitative synthesis, the study earned 
four points. If the methodology was any other design, but the study was longitudinal (i.e., at least three 
years of data), the study earned three points. If the methodology was multiple-baseline or narrative 
synthesis and the study was cross-sectional, the study earned two points. Any other design earned one 
point. 

• Duration: What was the duration for data collection? If data were collected over at least three years, 
the study earned four points. If the duration was between one and three years, the study earned three 
points. If the duration was between six months and one year, the study earned two points. If the 
duration was less, the study earned one point. 

• Sample bias: Were students kept in the study regardless of low performance? Were students* results 
reported in the findings regardless of low performance? Was the attrition rate below 20 percent? Were 
both experimental and control sample selections a priori rather than post hoc? If the answer to these 
questions was positive, the study earned four points. If there were one or two “not clear” responses, 
the study earned three points. If there were three “not clear” responses, the study earned two points. 
If any of the answers was “no,” the study earned one point. In general, studies tended to keep students 
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in the study and findings, regardless of performance, but many studies suffered from high attrition 
rates (especially longitudinal studies) or post hoc sample selection. 

• External validity: How many students were in each condition? How many classes? How many schools? 
If the study involved at least 50 students, at least five classes, and at least five schools per condition, 
it earned four points. There was some flexibility on any one of these points. Fewer students, classes, 
and schools resulted in fewer points on external validity. 

• Statistical conclusions: Did the study provide sufficient quantitative information to permit calculation 

of statistical effects? Were appropriate statistical tests used to analyze data? If the answer to both questions 
was study earned four points. If one was “not clear,” the study earned three points. If both 

were “not clear,” the study earned two points. If either answer was “no,” the study earned one point. 
Many studies provided some quantitative information but not enough to calculate effect sizes. For 
example, some studies provided means but not standard deviations, or percentiles but not number of 
participants. 

Level 4: Are differences between groups attributable to the approach? AIR assessed the degree to 
which each study satisfied internal validity standards in three areas: 



• Study design: What type of comparison or controls did the study use? Of the 10 experimental designs 
described in this section, the designs warranting four points were: randomly assigned subjects, stratified 
sampling, randomly assigned intact groups, and stratified randomly assigned intact groups. Designs 
that earned three points were: a priori match on demographic and achievement characteristics, group 
comparability at pretest on critical measures, a priori match on demographic characteristics, or 
statistical adjustment for small a priori differences. Studies using pre-post designs, including case 
studies, earned two points; other designs involving controls earned one point. This category, study 
design, is very similar to the internal validity category in Level 3. However, the ratings in the study 
design category tend to favor quantitative studies, while the ratings in the internal validity category 
tend to favor longitudinal case studies. The final methodology rating was calculated with only the 
higher of the two ratings — internal validity or study design — in order to give strong quantitative and 
strong qualitative studies similar weight. 



• Measures: Were measures adequately described or commonly recognized? Were they reliable (r > .75)? 
Did they assess skills taught in both experimental and control conditions? Was more than one measure 
of outcome used? Were some measures developed by someone other than the experimenter? Were data 
collected and analyzed by researchers other than the approach developer? Was adequate information 
available to assess degree of implementation? Did the study provide information on materials, roles, 
participants, and length of intervention? Were differences between conditions limited to the approach? 
To calculate the rating for this category, total earned points were divided by total possible points 
(generally excluding questions that are marked “not clear” unless there is a substantive reason to 
include them), and this ratio was multiplied by four to create a four-point scale. 

• Sample description: Did the study indicate that the approach was implemented in settings representative 
of actual instructional conditions? Were other instructional differences between groups (e.g., age, 
ethnicity, setting) described and adequately controlled? To calculate the rating for this category, total 
earned points were divided by total possible points (excluding questions that are marked “not clear”), 
and this ratio was multiplied by four to create a four-point scale. Very few studies earned below four 
points on this category for two reasons: 1) very few studies were not set in representative conditions 
and 2) very few studies identified differences between comparison groups and do not control for 
those differences. Many studies did not identify differences, and so received “not clear” ratings, for 
which they were iioi penalized in the sample category rating. However, this lack of information was 
captured in the study clarity rating described below. 

Study clarity. In addition to the substantive areas listed above, studies were rated on the clarity of 
information in Level 3 and Level 4. The intent here was to identify studies that systematically provided 
inadequate data to understand the methodology or replicate the study. Within each category listed above 
(e.g., sample bias, statistical conclusions), studies were penalized minimally for one or two “not clear” 
responses; however, the study clarity rating targeted studies with patterns of frequent “not clear” responses. 
Within Level 3 and Level 4, the proportion of “clear” responses was standardized to a four-point scale to 
calculate a clarity rating, for a total of two study clarity ratings. 
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Assigning Ratings for Evidence of Effects on Student Achievement 

Review Process 

Next, AIR summarized the strength of the research for each approach — with an emphasis on findings 
from studies with a methodological rating of 3.0 or above — using the rating criteria presented below. 
Because there was limited research on the effects of the approaches, a difference of one study could be 
quite meaningful. For example, an approach with a marginal research might have had one study; a single 
additional study would have doubled the information available.^ 

AIR researchers used Levels 5> 6, and 7 of the EREA to summarize findings from each study (Level 5)> 
make conclusions about the methodological strength of the study (Level 6), and rate the evidence of 
effects of the approach overall (Level 7). 

Level 5: Is the approach effective as determined by scientifically valid research methods? AIR reported 
all statistical information that could be used to calculate effects (e.g., number and percentile, effect size) in 
Level 5. Descriptive information about the measures (e.g., measure name, statistical tests used) also was 
recorded in Level 5. For studies that met methodological standards (rating of 3.0 or above), we used the 
information reported in Level 5 to complete the findings tables in Appendix C. 

Level 6: What is the quality of the research base underlying the approach? AIR researchers 
summarized methodology ratings within and across studies in Level 6, and entered the final 
methodology rating (i.e., an average of the 10 ratings in Levels 3 and 4). Descriptive information 
about the study (e.g., publication information, names of schools and districts in the study) also was 
recorded in Level 6. Only studies that earn a methodology rating of 3.0 or above were considered 
sufficiently rigorous to report their findings. AIR used the information summarized in Level 6 to 
complete the research tables in Appendix B. 

Level 7: What is the overall efficacy of the approach? This level synthesized information from the 
most rigorous studies (those earning a research rating of 3.0 or above) in terms of reported effects of the 
approaches! Researchers rated the research base as a whole, using information on the number of studies 
that met the-minimum criteria and the findings of these studies. 

Rating Criteria 

The rating criteria draw on multiple sources, including Stringfield (1998), National Center to Improve 
the Tools of Educators (1998), and the U.S. Department of Education (1998). The rating criteria were 
reviewed by the project's scientific advisors as well as other experts in educational evaluation. The final 
rating criteria reflect their comments and suggestions. 

0 = Strong evidence of positive effects on student achievement 

— At least four studies (or two studies and one research review/meta-analysis) that use a rigorous 
methodology and show positive effects on student achievement. 

— At least three of these studies that show statistically or educationally significant positive effects on 
students (i.e., effect size of at least .25, statistically significant at the p<.01 level, or gains greater 
than 10 percentiles). 

— No more than 20 percent of studies that use a rigorous methodology show negative or no effects^ on 
students. 

— To ensure that there is enough information to replicate any particular approach, at least one study 
must be available that provides information on implementation of the approach (high methodology 
rating not required). 

O = Promising evidence of positive effects on student achievement 

— At least three studies (or two studies and one research review/meta-analysis) that use a rigorous 
methodology and show positive effects OR a combination of one such study and at least six longitudinal 
(i.e., three years or longer) case studies (rigorous methodology not required) that show positive effects. 
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— At least one of these studies that shows statistically or educationally significant positive effects (i.e., 
effect size of at least .25, statistically significant at the p<.01 level, or gains greater than 10 percentiles). 

— No more than 30 percent of studies that use rigorous methodologies OR are longitudinal case studies 
show negative or no effects on students. 

— At least one study provides information on implementation of the approach (high methodology rating 
not required). 

= Marginal evidence of positive effects on student achievement 

= — At least one study that uses a rigorous methodology OR four longitudinal case studies (high 
methodology rating not required). 

— No more than 50 percent of studies that use rigorous methodology OR are longitudinal case studies 
show negative or no effects on students. 

(3 = Evidence of mixed, weak, or no effects on student achievement 

— At least one study that uses a rigorous methodology OR two longitudinal case studies (high 
methodology rating not required) that show inconsistent, mostly negative, or no effects on students. 

? = No research on effects on student achievement 

— Insufficient data on student outcomes: no studies use rigorous methodology AND there are fewer 
than two longitudinal case studies. 

The criteria evaluate two dimensions of the evidence of positive effects on student achievement: size 
of the research base, and strength of the findings. The highest-rated approaches must have multiple studies 
that meet the EREA criteria for rigorous research (methodology rating of 3.0 or above), the vast majority 
of the research must show positive effects, and a majority of the findings must be statistically or 
educationally significant. 

Overall, the ratings flow from more to less research and from stronger to weaker positive findings. 
The fourth rating, evidence of mixed, weak, or no effects on student achievement, is an exception. This rating 
is used for approaches that may have the number of studies required for a marginal rating, but the studies 
show inconclusive or negative effects on students. Thus, an approach with one rigorous study that shows 
positive effects would be rated marginal, while an approach with at least one rigorous study that shows 
ambivalent or negative effects would be rated mixed, weak, or no effects, and an approach with no rigorous 
studies at all would be rated no research. 

Several conditions in these rating criteria have been tailored for this guide. First, the criteria incorporate 
both quantitative and qualitative research. Since the guide reports on measurable improvements in student 
achievement, quantitative results are necessary for a high rating. However, the sponsoring organizations 
and AIR recognized the need to include a variety of research designs, including well-conducted qualitative 
studies. Therefore, in certain cases, the rating criteria permit a large number of longitudinal case studies 
to be substituted for a smaller number of studies that use a rigorous methodology. This was done to 
compensate for the quantitative bias of the EREA, as high-quality qualitative studies (e.g,, well-conducted 
longitudinal case studies) are less likely to meet the criteria of the EREA than high-quality quantitative 
studies. That particular case never occurred during AIR s review, in part because the EREA was successfully 
adapted to include qualitative research. However, AIR kept the condition in the rating criteria to emphasize 
the intent to incorporate a variety of research designs. 

Second, the rating criteria make a distinction between positive findings and significantly positive 
findings. To earn a strong or promising rating, an approach must have studies with positive findings; further, 
some — but not all — of these studies must report findings that are educationally or statically significant. 
For example, strong evidence of positive effects calls for four or more studies with positive student 
achievement findings, of which at least three must have significantly positive findings. Again, this condition 
is intended to incorporate findings from qualitative studies, which are unlikely to report effects in terms 
of measurable significance, as well as quantitative studies, which are likely to report significance levels. 
Further, some quantitative studies provide ample evidence of strong positive effects (e.g., a large rise in 
test scores across the school), but neglect to include some piece of information (e.g., the exact number of 
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students tested) that would be necessary to calculate significance levels. However, if studies passed the 
EREA criteria for rigorous methodology on other counts, AIR considered them when rating an approach. 

Third, the criteria accommodate studies that report mixed effects on achievement. For example, a 
study that shows a positive effect on reading and a negative effect on mathematics test scores would be 
credited both as a study with positive effects and a study with negative effects.^ Each study, rather than 
each outcome, is considered equally for the rating, so that both positive and negative outcomes are 
recognized. 

Fourth, the rating criteria consider information on implementation. To earn the highest ratings, an 
approach must have research that reports both implementation and effects. This condition ensures that 
statements can be made about the interaction between level of implementation and effects on students. For 
example, although a particular developer might not require or provide extensive staff development, it would 
be important to know that all schools that made significant student achievement gains, using the approach, 
chose to contract for such services. In addition, researchers need information on the implementation level if 
they want to accurately replicate the research. 

The reported analyses treat all studies equally. In fact, studies differ on a number of dimensions, 
including the number of schools studied, the number of grade levels tested, the number of outcome 
measures used, and the number of students included. 

To examine the sensitivity of the results to alternative asumptions about the studies, supplementary 
analysis was conducted based on one assumption, that number of schools in the study matters. Studies 
with one to 20 schools were assigned a weight of one, and studies with more than 20 schools were assigned 
a weight of two. Weighting the analyses had minimal impact: it raised the ratings for three borderline 
cases and lowered the rating for a fourth borderline case. We retained the original rating strategy, in 
which studies were the unit of analysis, for three reasons. First, the number of studies reflects the potential 
breadth and variety of the research. Second, the limited information available on the studies would not 
support a truly accurate weighting scheme. Third, the supplementary analysis suggested that weighting 
had minimal impact. 



^ For example, some materials originally classified as studies were, upon closer inspection, promotional materials 
reporting anecdotes of successful reform. 

2 One of the most critical changes to the EREA was to change the ratings system from exclusionary to summative. In 
the original version, studies were automatically dropped if they did not meet certain criteria. In the revised version, 
studies were rated on a number of criteria; the average rating across criteria was used to determine whether the study 
should be used or dropped. A second critical change was in the rating criteria used to summarize research across an 
approach. The revised version incorporates the original criteria, those recommended by Stringfield (1998), and 
those identified in the guidance to the Comprehensive School Reform Demonstration Act. 

^ AIR reviewed available information on implementation but did not include it in the methodology rating. There 
are three reasons for this decision — two methodological and one an artifact of the available research. First, most 
studies did not provide adequate information on implementation, and so ratings in that area would be suspect. 
Second, the methodology rating is intended to reflect the quality of the study, rather than quality of implementation 
of an approach at a particular site. We discuss implementation in other sections of the report. (See Appendix E for a 
description of implementation data collected and reported.) Third, including both well and poorly implemented 
studies in the discussion of effects allowed AIR to look at data and make statements about the relationship between 
implementation level and effects of the approach. If studies had been systematically eycluded from analysis because 
the approaches were poorly implemented at the sites studied, AIR could not haye addressed this question. 

^ Because the number of studies matters, a study that appears as a paper and, in modified format, as a journal article, 
was reviewed and reported only once, using the most recent version. Some longitudinal studies involved multiple 
reports over the course of data collection. In such cases, we reviewed the most comprehensive report. If other reports 
from this study provided unique data or analysis (e.g., an implementation report in year one and an outcome report 
in year three), we also reviewed those reports. 

5 For a study to show “negative or no effects,” at least one-third of its findings must be negative or ambiguous. 

^ Ratings are not separated by subject area, as the limited data would not support this level of analysis. 
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Strength of the Research on Student Achievement Outcomes for Audrey Cohen College: Purpose-Centered Education 

No studies on effects of Audrey Cohen College:Purpose-Centered Education on students are publicly available. However, the developers 
collect and make publicly available standardized test score data on Audrey Cohen College: Purpose-Centered Education. 
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Strength of the Research on Student Achievement Outcomes for Community for Learning 

(all ratings on scale of 1-4, with 4=best) 
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Strength of the Research on Student Achievement Outcomes for Co-NECT 

(all ratings on scale of 1-4, with 4=best) 
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Strength of the Research on Student Achievement Outcomes for Different Ways of Knowing 

(all ratings on scale of 1-4, with 4=best) 
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Strength of the Research on Student Achievement Outcomes for Direct Instruction 

(all ratings on scale of 1 -4, with 4=best) 
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Sitrength of tlie Research on Student Achievement for Expeditionary Learning Outward Bound 

(all ratings on scale of 1-4, with 4=best) 
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Strength of the Research on Student Achievement Outcomes for High Schools That Work 

(all ratings on scale of 1-4, with 4=best) 
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Strength of the Research on Student Achievement for League of Professional Schools 

(all ratings on scale of 1-4, with 4=best) 
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Strength of the Research on Student Achievement Outcomes for Onward to Excellence 

(all ratings on scale of 1-4, with 4=best) 
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Strength of the Research on Student Achievement Outcomes for Roots and Wings 

(all ratings on scale of 1-4, with 4=best) 



O 

ERIC 



s ^ M 

S' h ' " 


o 

rn 


p 

rn 


p 

<s 


r 'L'. 

V.-’g'-C-'' 


ro 


rn 

p 


ro 

p 


.(9 

, ■« .-2 
’ ’o.-'S.;' 

:• •S-'C-r, 

■ :‘a- V 


o 


p 


p 


- 

• I'S 

mi 


rn 


(N 


p 

cvi 


- t 'r 

. s. 8-" 

; «o as. 


p 

<s 


p 

rn 


p 

(S 


■ '-5 

■ '•Siia-' 

.05;'^ 


p 


p 


p 




p 


p 


p 


^ . S-' ” 

- e .2 


p 


p 

rn 


p 

ro 


. »-0 >.'• 

" ^ . r 

r/ss-t.:' 


p 


p 

Tt- 


p 




p 


p 


p 


O 

' • O'. 

r ... 
iMmmmm 
\ a- ':" 

• la •• 


o> 

o. 

Q 


s 

o> 

13 

C 

0> 

a. 

u> 

13 

C 

^i>4 


i-m 

0> 

cx 

'w 

Q 


-1' « 
-2. • 
V;,- , O- , . 


a ^ 
*> 

ed ON 
^ 2 
c ^ 

§ s 
11 


JS 

60 

*c 

o> 

T3 

•V oo 

^ g; 

o ^ 
0^ O 


i 

"o 

Q 

c 

0> 

11 
C ad 

II 



o 

CO 






B-11 



Strength of the Research on Student Achievement Outcomes for School Development Program 

(all ratings on scale of 1 -4, with 4=best) 
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Strength of the Research on Student Achievement Outcomes for Success for All 

(all ratings on scale of 1 -4, with 4=best) 
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Strength of the Research on Student Achievement Outcomes for Talent Development High School 

(all ratings on scale of 1-4, with 4=best) 



CO 




ERIC 



U 

a 

U 

.s 

s 

a 

pfi 
.© ‘ 



CO 

(D 



CO 
© 

a 



a 
© 

a 

© 

a 
2 
o 



O 

(U 

2 

o 

CO 

a 

O 



S ^ 

^ .s 

5 t 

c/} ^ 

a 2 
o ^ 

p© 

o 

© 

CO 

© 

p© 



p© 

a 

£ 

O) 



.«a 

5 :| a 


r4 


p 


cs 

cs 


cs 


Kfl 0 


ci 


p 

cj 

p 


fS 


p 

cj 

p 


V Sample 
Description 


<z> 

Tf 


p 

Tf 


p 


p 

Tf 


.,.vl| '.i 


CO 


(N 


»n 


CO 


M P ; 


o 

fS 


p 


p 


p 

fS 


. -Jris v; 


p 

CO 


p 


p 


p 

rn 


. I<; « i 

■ ;P,> .:i 


p 

CO 


p 


p 


p 


*3- 2 ■: 

© ,2- ■•' 

? 


p 


p 


p 

fS 


p 

fS 


■ 

■■■ 1,^0 ^ 
"■J®- 


o 

fS 


p 

fsi 


p 

fO 


p 

fS 




p 

Tf 


p 


p 


p 


■•"a 


<u 

T3 

c 

0> • 
Qp 
0> 
*0 


S 

(i> 

T3 

G 

0> 

Qp 

0> 

T3 

G 


bp 

0> 

Qp 

O 

*a> 

> 

o> 

Q 


bPi- 

0> 

Qp 

O 

> 

0> 

Q 






o 

tj 

0> 

Oe:; 

pC 

•e ^ 

o 2^ 

to 

< w 


u 

O 

t5 

0> 

V 

JS 

1§5 
< c 


o\ 

o\ 

V— ^ 

o 

CO 

O 

c 

o 

Q 


o\ 

os 

C/!) 

C/D 

< 

Pu 

< 



(U 

2 

(U 

U 

bO 

c 



ed 

(U 

.J 

g 

pP 



c 

0 

1 

TD 

2 
o 
o 

CO 

ts 

JU 

2 

ed 



ed 

[o 

2 

S. 

CO 

ed 



o 

2 

o 



(U 

(U 

> 

(U 

T3 

(U 

p© 

H 



LO 

CO 

t— i 



Appendix C 

Summary of Findings on 
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Summary of Effects on Student Achievement for Accelerated Schools 
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Summary of Effects on Student Achievement for America’s Choice 
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Summary of Effects on Student Achievement for Community for Learning 
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Also includes data from the 1994-1995 and 1993-1994 school years. 



Summary of Effects on Student Achievement for Community for Learning (Continued) 
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Summary of Effects on Student Achievement for Community for Learning (Continued) 
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Summary of Effects on Student Achievement for Co-NECT 
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(continued) 



Summary of Effects on Student Achievement for Core Knowledge (Continued) 
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Summary of Effects on Student Achievement for Different Ways of Knowing 
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Summary of Effects on Student Achievement for Different Ways of Knowing (Continued) 
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Summary of Effects on Student Achievement for Direct Instruction 
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Summary of Effects on Student Achievement for Direct Instruction (Continued) 
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Summary of Effects on Student Achievement for Direct Instruction (Continued) 
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Summary of Effects on Student Achievement for Direct Instruction (Continued) 
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Summary of Effects on Student Achievement for Direct Instruction (Continued) 
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Summary of Effects on Student Achievement for Direct Instruction (Continued) 
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Summary of Effects on Student Achievement for Direct Instruction (Continued) 
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Summary of Effects on Student Achievement for Expeditionary Learning Outward Bound 
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Summary of Effects on Student Achievement for Expeditionary Learning Qutward Bound (Continued) 
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Summary of Effects on Student Achievement for Expeditionary Learning Outward Bound (Continued) 
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Summary of Effects on Student Achievement for High Schools That Work 
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Summary of Effects on Student Achievement for High Schools That Work (Continued) 
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Summary of Effects on Student Achievement for High/Scope K-3 Model 



er|c 



I 

I 






•2 2 

a ^ 
5 V 

ss 



a; 

9 " 
o 

hi 

S ' 
~ 9 

s 

O: 



ja /■' 

V .01 

2-5^ 

Pi 



9~ 

O 

CO 



^ c iS 
o> o c: 

Ou .2 

« o 

o> C <u 
'*7* O O 

4l* O O 



C/3 

0> 

0> 

’S s 

■§ o 

<N J3 

I 8 

0 > c/3 
*0 C/3 

§)| 

©■.2> 

o 



T3 

0> 

kM 

o 

0 

(/I 

i2 

c 

u 

T3 

1 



g § 









22 

o 

o 



0> 

1- 



W W 

2 E 



o=? 

O 
C/3 






0> 

J ^ 

§ 

s 

c c /1 
. 4> 2 U 

s-ci 

f-a^^ . 

“ S § & o 

a I -a 8 -b 

C/3 



O 

0> "fa 

•8 « § 

0 

c/l C 
^ T3 S 

1 

B -S 

c/J S 

« ■ 

”^-§' no 
<N 2 

o 

O 



0> 

x: 

a - GO 

IS 



at 



<N 



c/i 

^ 8 



0> 

-§> 



o 

0 

c /1 

i2 

c 

u 

T3 

1 

C/3 

K 

c/T ' 



o> 



^ (N ^ c/3 5 

B* b S 42 o 

I S m.2P;« 

8 >- 2 s o 



£ ^ 2 
so c/> 

- 4) 

CL 
O 
o 

m c/3 

S3 ^ 

8 S.SP 

X K 



s § 

-5 



o 

•o '§'! 
2 o 

GO O 

22 C/3 
ed Q 

C ■ 



no C/3 

2 K 
S u 

cin -O 

I a 

tt>*p 
t/i )b 
O 

dj ^ 
■§ § 
a ’i 

I c/3 



(N .= T3 

"o § 

o <ii ^ 

§ 

< £ :S 



c/3 

C/3 



<N 
0> 0> 
■ ^ I— 



^ *2 CM 

2 ^ u 

<b 42 C GO 

cs w w 2 

8 ^ p §) 

^ ’S ^ § 

^ b c/3 J 

•O 8 K c 
55 c ^ « 

9 -o a 2 

§ 2 a' c 

5 "> (s 8 

Sgg-Sy, 

la ^ 2 § 

■g a^ B 

s«: 8 s 

"-.“of 

- §1- 

u U C u 

cd kri 

o 

u 



c/3 S 

O ’B 

e " 
c/3 ^ 

§ 2 
-S o 

^ o 



§ 

■s 

Urn 

0> 

-§> 



£> g 

42 -O 

•o 2 

W In 

O c/3 

a X 



m V 

2 c ^ 8 



0> 

b’S 

•s a 

■3-s' « 
m "o 
c/3 . ^ H 

X ^ i 

«» o o 
•0^0 

2 o 55 

&) o O 



0> 

;§) 

IE 

*o 
u 

k« 

0 

C4 
c /1 

c: 
u 
*o 

1 

c/3 

X 

u 

1 a 

.1. I 

*o 



*o 

U 

k« 

0 

C4 

c /1 

c: 

u 

*o 

1 

c/3 

X 

0> 



T3 

0> 


o 

CO 

"rt 


M 

o 




u 


c 


CO 


o> 


c 


*o 


u 


CO 


*o 




1 




c/3 «0 


X 


no 

M 


0> 


1 



*5 

m 

*o 



m ^ CO 
O -T O 

O W, <0 

42 E C 
C4 JU O 
C/3 ^ O 

< i c/3 



o 

is 

c 

o 

o 

c/3 

C/3 



c c C/3 

c/5 c oS 

b I 

0 O u u *g 

M c/3 M X c /1 



0> 

E 

— 

o > 
o «> 

•f? ^ 

C4 o 
C/3 c5 



c/3 M 



£•2 § S 
S.-8^§ 

O o C/3 2 

C4 ♦- w75 
C/3 CO —I ^ 



o -ts 

^ CO ^ 

5* 8 P >C/3 

<0» GOcoOO^S ?w 



Q,"^ CL O 
C -Sv 3 O S 

c .sp o 4 ? .c 



< - 

^ o 

c/i 2 •« 

CL C ^ 
3 O W 

P ^ 'g 
'E 
E 



CO 



u 

1^, 

O 

CN 42 
^ o 
O c/3 
O ^ 
42 o> 
o .ti 

' C^ CO 



GO 
U 
CL 

o 0> 

si 

.£P ^ 
K ^ 



3 C/3 

= ^ 

O C/3 



0> 

> 



o ^ 



4^ 

C/3 X 

'i S 

OQ 



CO .b 

C M 

o> E 
42 m 
. a> , 

CL o 

S CO 

O 0 > 

U H 



4< « 

c/3 O 



o ^ 
H c/3 



&) 

■i 



lO 

<r> 

Cst 



CO 

CNi 



C-24 



Summary of Effects on Student Achievement for League of Professional Schools 
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Summary of Effects on Student Achievement for Onward to Excellence 
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Summary of Effects on Student Achievement for Paideia 
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Summary of Effects on Student Achievement for Paideia (Continued) 
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C-28 



mary of Effects on Student Achievement for Roots and Wings 




‘ The Tennessee Value-Added Assessment System uses scale scores to produce estimates of mean academic gains for each student, and compares the gains against nationally normed 
gains for that grade and subject to estimate expected gains for students. The cumulative percent of norm mean gives the percent of expected gains actually attained. A score of 100% 
(1.0) indicates achievement at the national (expected) level for that subject. 
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Summary of Effects on Student Achievement for Roots and Wings (Continued) 
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Summary of Effects on Student Achievement for School Development Program 
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Summary of Effects on Student Achievement for School Development Program (Continued) 
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Summary of Effects on Student Achievement for Success for All 
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Summary of Effects on Student Achievement for Success for All (Continued) 
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Summary of Effects on Student Achievement for Success for All (Continued) 
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Summary of Effects on Student Achievement for Success for All (Continued) 
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Summary of Effects on Student Achievement for Talent Development High School 
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Appendix D 

Criteria to Evaluate Support 
Developers Provide Schools 



This report presents information on four aspects of implementation: 1) the support developers 
report they provide schools; 2) the steps developers require or encourage schools to take to implement the 
approaches; 3) the scope of implementation in terms of how long the approach has been in schools and 
how many schools are implementing it; and 4) findings from research on implementation. Although the 
report contains information on all four aspects, only the first — support that developers provide schools — 
is rated. 

Support the Developer Provides Schools 

Review Process 

To rate the level of support developers ^ provide schools as they implement the approaches, AIR reviewed 
materials developers provided as well as information gathered in telephone interviews with each developer. 
Each researcher was responsible for several of the 24 approaches. For each approach, the researchers asked 
the developer a series of questions on professional development and technical assistance, reviewed 
informational materials provided by the developer, and conducted telephone interviews with at least three 
schools using the approach (see Appendix G). The researchers then described the findings in the profiles 
(see Support the Developer Provides Schools) and assigned a rating to each approach based on these findings 
and the rating criteria described below. The project developer reviewed all ratings, in many cases rereading 
original materials or speaking with approach developers to clarify ambiguous points. Developers were 
given an opportunity to review their profiles, including the support ratings, and provide supplementary 
evidence if they felt their approaches had been mis-rated. 

Review Criteria 

AIR considered the following factors in developing the rating criteria: 

• Access to appropriate types of support: Most developers offer a variety of types of support (e.g., visits 
from the developer, newsletters, telephone consultation with the developer, access to the developers 
Web site) to meet a range of needs. Some developers provide proactive, on-site assistance, to help 
schools work through issues with implementation before problems undermine the implementation 
process. 

• Frequency and duration of support: Frequency of contact and duration of support indicate the level of 
interaction schools might expect of the developers. Developers may work closely with each school, or 
may provide an approach and encourage the schools to work independently towards reform. 

• Tools to help schools evaluate their implementation progress: Some developers provide benchmarks against 
which schools can monitor their implementation of the approach. Others help schools develop their 
own implementation plan, including schedules for expected progress. 
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Based on these factors, the following rating criteria for evaluating the implementation support developers 
provide schools were developed: 

0 = Strong support for schools 

— Developers provide training before implementation. 

— During the first year of implementation, developers schedule at least four on-site technical assistance 
visits to provide schools with regular guidance OR developers provide extensive training (e.g., at least 
one week in the first year) to a full-time on-site facilitator. 

— Developers provide off-site support (e.g., technical assistance through an interactive Web site, on- 
line assistance, over the telephone, or at off-site meetings). 

— Developers provide supportive materials (e.g., newsletter, non-interactive Web site). 

— Developers provide training and technical assistance support for at least three years. 

— Developers provide an indicator system or help schools develop their own indicator system to track 
implementation progress. 

O = Promising support for schools 

— Developers provide training before implementation. 

— During the first year of implementation, developers schedule at least one on-site technical assistance 
visit to provide guidance OR developers provide extensive training to a part-time on-site coordinator, 

— Developers provide off-site support. 

— Developers provide support for at least three years. 

= Marginal support for schools 

— Developers provide training before implementation. 

— In addition to training before implementation, developers provide access to on- or off-site support in 
response to schools’ requests through the first year of implementation. 

Q = Weak support for schools 

— Developers do not provide any specialized technical assistance beyond training before implementation. 

As AIR applied these rating criteria to the information developers had provided, we clarified three 
areas of ambiguity. The first relates to developers* efforts to support schools’ full implementation of their 
approaches. Many developers help schools evaluate the outcomes of their approaches, particularly changes 
in student achievement. But these evaluations may not be sufficient to support the implementation process. 
Therefore, the rating system also focuses on developers* efforts to help schools monitor and/or evaluate 
their implementation of the approaches by tracking changes in curriculum, instruction, governance, school 
organization, and so on. 

The second area of ambiguity is the distinction between proactive and reactive assistance. Most 
developers emphasize that they are available in response to questions or concerns voiced by school staff. 
To earn a high support rating, however, the developer must provide frequent guidance throughout the 
process as a matter of policy, without waiting for problems to surface. 

Finally, some developers train on-site coordinators rather than sending their own staff to schools for 
technical assistance visits. These rating criteria recognize that the developers* requirements for coordinators 
affects the level of implementation support that schools experience. If a developer requires the coordinators 
to make a full-time commitment, and trains them accordingly, the approach receives a higher 
implementation support rating than if the developer requires the coordinators to make a part-time 
commitment, and trains them accordingly. 

Implementation Requirements 

Each profile describes the steps that developers require or strongly recommend schools take as they 
implement the approaches (see Implementation Requirements and Schoob* Experiences), This information 
was drawn from interviews with the developers (see Appendix G) and supplemented with informational 
materials provided by the developers. 
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Scope of Implementation 

The year the approach was first used in a school and the number of schools using the approach as of 
October 30, 1998 are reported in the profiles and on the table on page 4 of the guide. 

Research Findings 

In addition to information on implementation from the developers, AIR examined implementation 
successes and challenges reported in studies. This information is reported in Appendix E, and summarized 
in the profiles (see Implementation Requirements and Schools* Experiences), 

. AIR drew implementation data from studies that: reported student achievement outcomes (which 
also were reviewed for methodology, using the EREA process described in Appendix G); and focused on 
implementation exclusively.^ AIR reviewed these studies in different ways. For the outcome studies, we 
evaluated whether the schools in the studies fully implemented the most important aspects of the approach. 
For implementation studies, we evaluated implementation of the most important aspects of the approach, 
as we had done with outcome studies, and we also summarized major findings using a series of questions 
on implementation. These steps — evaluating implementation and summarizing implementation findings — 
are described below. 

Evaluating Implementation 

To evaluate the information each study contained about schools* implementation of an approach, 
AIR: 1) identified critical components of each approach; 2) reviewed studies for evidence that schools 
had implemented these components; 3) assigned an implementation rating for each component; and 4) 
assigned an overall implementation rating. Each researcher was responsible for reviewing outcome and 
implementation studies for several approaches. 

To identify critical components of the approaches, AIR researchers interviewed the developers (see 
Appendix E for the Interview Guide) and reviewed promotional materials. During telephone interviews, 
the researchers asked the developers to describe the following elements of the approach: 

1. time and scheduling requirements; 

2. student placement and scheduling requirements; 

3. staffing and professional development requirements; 

4. instructional materials; 

5. professional development; 

6. procedures to monitor student progress and performance; 

7. administrative support needed to support implementation; and 

8. family or community involvement. 

AIR researchers asked each developer to rate each element as “critical,” “not critical,” or “not relevant” to 
successful implementation. 

Next, the researchers reviewed both outcome and implementation studies for evidence that the schools 
in the studies had implemented the approaches consistent with the developers* expectations. For each 
approach, a researcher completed information about each component (e.g., time and scheduling 
requirements); indicated whether the component was “critical,” “not critical,” or “not relevant,” to 
implementation according to the developer; noted relevant information about a schoofs implementation 
(e.g., “grouping was homogeneous, as recommended, but regrouping did not occur as frequently as 
iccoiiimcndcd”); and judged whether the school's implementation of each component, was ‘’good," 
“adequate,” “poor,” or “not clear.” 

The researcher then gave each study an overall implementation rating. A study was rated “good” if the 
implementation of all critical components was good and the implementation of all non-critical components 
was good or adequate; “adequate” if the implementation of all critical components was good or adequate and 
the implementation of one non-critical component was poor; “weak” if implementation of no more than one 
critical component was poor and the implementation of all other components was good or adequate; and 
“inadequate” if more than one critical component was poorly implemented. 
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The process of maintaining inter-rater reliability for outcomes studies is described in Appendix G; 
this process also applies to the implementation ratings section of the review. For implementation studies, 
the project director reviewed implementation ratings for 10 percent of the studies. In cases of discrepancy, 
the project director and researcher reviewed the data and reached consensus on the rating. In such cases, 
the discrepancies and supporting evidence for the final rating were documented. 

In practice, this rating system was limited by the information provided in the studies. Many studies 
provided little or no information on the schools’ implementation of components the developers considered 
critical. 



Summarizing Implementation Findings 

To summarize findings from implementation studies, AIR evaluated the implementation of critical 
components of each approach using the procedures discussed above. In addition, AIR researchers reviewed 
findings from each implementation study using the following questions as guidelines: 

1. How long had the school been using this approach at the time of the study? 

2. How did the school select the approach? 

3. If the approach involves a planning period, how long did the planning period last? Was that 
enough time to prepare? Too much time? 

4. How did the study evaluate quality of implementation? For example, did the study look at 
progress towards milestones? Survey teachers on their satisfaction with or the effectiveness of 
the approach? 

5. How did the school implement the approach — were all components operationalized 
simultaneously, schoolwide? Were some components or grades phased in? How did this 
approach to implementation seem to affect the quality of the implementation? 

6. What components of the approach are especially difficult to implement? 

7. Typically, what happens when the school tries to implement these difficult components? 

8. What components of the approach are especially easy to implement? 

9. What qualities of the approach/school/staff/ technical assistance/etc. contribute to successful 
implementation? 

10. Did the school make any adaptations to the original design? If so, give an example of the 
adaptation, and describe the reasons for making that adaptation. Did the adaptation work? 

11. How much technical assistance did the school receive? What types of support? What was 
the source? 

12. How much professional development related to the approach did the school receive? What 
was the source? 

13. If the study includes information about costs, describe those data. What expenditures were 
beyond the expenditures described by the developer? 

14. Describe major findings of the implementation study, if they are not captured by the questions 
above. 

Findings for each implementation study are reported in Appendix £, and findings across studies are 
summarized in the profiles. 



^ For some approaches, such as Accelerated Schools and Direct Instruction, implementation support is available 
from sources other than the developer. 

2 In many cases, the distinction between outcomes and implementation studies was ambiguous. AIR used this decision 
rule: studies that reported any outcome data at all were considered outcomes studies. Researchers reviewed those 
studies using the EREA (including the implementation rating). All other studies that reported implementation data 
were considered implementation studies. Some of the “outcomes” studies that were reviewed with the EREA focused 
primarily on implementation. These studies tended to not pass the EREA criteria for rigorous methodology. Although 
initially identified as outcomes studies, these studies also were reviewed as implementation studies. Thus, the studies 
whose classification was most ambiguous — both outcomes and implementation — were reviewed as both types. 
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Summary of Implementation for Accelerated Schools 
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Summary of Implementation for Accelerated Schools (Continued) 
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Summary of Implementation for America’s Choice 
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Summary of Implementation for ATLAS Communities 
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Summary of Implementation for ATLAS Communities (Continued) 
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Summary of Implementation for Audrey Cohen College: Purpose-Centered Education 
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Summary of Implementation for Coalition of Essential Schools 
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Summary of Implementation for Coalition of Essential Schools (Continued) 
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Summary of Implementation for Coalition of Essential Schools (Continued) 
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Summary of Implementation for Coalition of Essential Schools (Continued) 
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Summary of Implementation for Coalition of Essential Schools (Continued) 
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Summary of Implementation for Community for Learning 
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Summary of Implementation for Community for Learning (Continued) 
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Summary of Implementation for Community for Learning (Continued) 
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Summary of Implementation for Co-NECT 
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Summary of Implementation for Co-NECT (Continued) 
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Summary of Implementation for Core Knowledge Schools 
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Summary of Implementation for Different Ways of Knowing 
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Summary of Implementation for Direct Instruction 
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Summary of Implementation for Direct Instruction (Continued) 
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Summary of Implementation for Expeditionary Learning Outward Bound 
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Summary of Implementation for Expeditionary Learning Outward Bound (Continued) 
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Summary of Implementation for Expeditionary Learning Outward Bound (Continued) 
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Summary of Implementation for Foxfire Fund 
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Summary of Implementation for High Schools That Work 
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Summary of Implementation for High Schools That Work (Continued) 
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Summary of Implementation for High Schools That Work (Continued) 




O 

cn 

CO 



cr. 

cv 

CO 



E-27 



Summary of Implementation for High Schools That Work (Continued) 



O 

ERIC 




: Sd 

va ■ 

•M , < 






O w 

£ ^ 

es 

W) 

•= ’o 

V o 
o 0> 

s I 

J I? 

o. V 9 

c ^ S 
— a « 

fe « 

<u ^ o 

^ ^ h 

a -e g. 

G 

J? M M 

<1> H 

ESS 

(U O 3 
*4J CO 5* 

^ h B 

^ Js o 
< o o 



0) 

O 



I 

0> 

a 

o 

CZ 5 



a 

o 

■M 

a 

0> 

s 

pii 

a 

a 



A 

a 

a 

9 

CZ) 






2 . 

C®“ o ' 
“ & . 

.. a- 



" o u ^ 

o a 

-g:^, 
.<» "S , 
a 



l-’l-:'!- 

2 .'S:r 

c8 o 



" b --i '"* 

® -S .o: 

^ £ f 

B 8 : i 
i>^o 



%■■ 



ffl^ 

I ,co S 



,1 

'. 9 
...o. 

(» 



P o E 
5 O O _ 

O o * 5 
E a o 

c/3 O 



£ >^ 






4> 

>» 

(N 



O. 

cd 



o> 

3 

a. 

B 

o 

o 

t 

T3 



o 

o 



a> *0 

II 

CO O 
CO iM 

oi o. 

CO 

4> C 



O 

E S 

O Vi 

2 J 

CO Tt 

M b 

U a. 



6 



T3 « 

0> CO 

*a « 
c .9 

rn « 
UJ CO 






CO 

o 

a, 

o> 

od 



G . 

I> 

ed 

i 



i- 

•g 0\ 
c/3 O 



o/ 

cr. 

OT 



00 



oi 



Summary of Implementation for League of Professional Schools 



er|c 




CO 

CO 



a^ 

2 



CO 

CO 

C'5 



Summary of Implementation for League of Professional Schools (Continued) 
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Summary of Implementation for Modem Red Schoolhouse 
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Summary of Implementation for Onward to Excellence 
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Summary of Implementation for Paideia 
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Summary of Implementation for Roots and Wings 
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Summary of Implementation for School Development Program 
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Summary of Implementation for School Development Program (Continued) 
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Summary of Implementation for School Development Program (Continued) 
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Summary of Implementation for Success for All 
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Summaty of Implementation for Success for All (Continued) 
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Summary of Implementation for Success for All (Continued) 
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Summary of Implementation for Urban Learning Centers 
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Appendix F 

Summary of Findings on Costs 



Costs for Sample of Sites Using Accelerated Schools 
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Costs for Sample of Sites Using America’s Choice 
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Costs for Sample of Sites Using America’s Choice (Continued) 
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Costs for Sample of Sites Using ATLAS Communities 
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Costs for Sample of Sites Using Audrey Cohen College: Purpose-Centered Education 
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Costs for Sample of Sites Using Basic Schools Network 



O 

ERIC 




r- 

CO 



o 

CO 



Costs for Sample of Sites Using Coalition of Essential Schools 
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Costs for Sample of Sites Using Community for Learning 
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Costs for Sample of Sites Using Co-NECT 
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Costs for Sample of Sites Using Core Knowledge 
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Costs for Sample of Sites Using Different Ways of Knowing 
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Costs for Sample of Sites Using Different Ways of Knowing (Continued) 
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Costs for Sample of Sites Using Direct Instruction 
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Costs for Sample of Sites Using Expeditionary Learning Outward Bound 
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Costs for Sample of Sites Using The Foxfire Fund 




ERIC 



CD 

CO 

CO 



CO 

CO 



F-15 



Costs for Sample of Sites Using High Schools That Work 
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Costs for Sample of Sites Using High/Scope K-3 Model 
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Costs for Sample of Sites Using League of Professional Schools 
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Costs for Sample of Sites Using Modem Red Schoolhouse 
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Costs for Sample of Sites Using Onward to Excellence 
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Costs for Sample of Sites Using Paideia 
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Costs for Sample of Sites Using Roots and Wings 
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Costs for Sample of Sites Using School Development Program 
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Costs for Sample of Sites Using Success for All 
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This estimate is based on the assumption that the school will implement all components of the approach. The cost is lower if fewer components are used. 



Costs for Sample of Sites Using Talent Development High School 
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Costs for Sample of Sites Using Urban Learning Centers 




Because this approach is targeted toward large, urban schools enrolling students from kindergarten through 12* grade, costs are estimated for a school of 50 to 75 
sachers. The profile and overview table report estimates for a school of 25 teachers. This estimate was calculated by dividing the total by 62.5 (an average number of 
sachers) for a per-teacher cost, and multiplying the per-teacher cost by 25. 

This site has not formally joined the Urban Learning Centers, but receives many of the same support services as the other Urban Learning Center schools. 




Appendix G 

Data Collection Activities 



Data collection activities consisted of three major tasks: collecting available documentation and research on all 
of the approaches, interviewing the developer of each approach, and interviewing personnel from a random sample 
of three to five schools using each of the approaches. 

Document Collection 

To provide a comprehensive and definitive review of the research available on each of the 24 schoolwide 
reform approaches, AIR: 

• Asked each developer to identify research related to their approach during a telephone interview. 
Copies of this research were then obtained. 

• Conducted a search of the Educational Resources Information Center database from 1976 to the 
present. 

• Reviewed the previous ten years of nine key education research journals, using the Rexkr's Guide to 
Periodical Literature 3nd the Education Index: 

- American Educational Researth Journal 

- Arrierkanjournd of Education 

- Educational Leadership 

- Educational Reseanh and Evaluatim 

- Educational Researcher 

- Harvard Educational Reiiew 

- Journalof Education JbrStuderUs Placed at Risk 

- Reiiew of Educational Research 

- School Efiktiueness and School hnprou^^ 

• Searched Education Week (1988-present) to locate references to approaches and research on the 
approaches. 

• Collected relevant materials from Robert Slavin and Sam Stringfield, Center for Research on the Edu- 
cation of Students Placed at Risk, Johns Hopkins University, who have previously performed 
overview research on comprehensive school reform approaches. 

• Located and obtained articles referenced for each approach in the Catalog of School Refirnn Modds: First 
£^/irwr(ISIWREL1998). 

• Reviewed bibliographies of research articles collected through the above methods to locate further 
related research. 

• Asked colleges in the following organizations to review the collected references to identify and help 
fill potential gaps: 



- Regional laboratories and research centers, through the National Education Information 
Knowledge Association; 

- RAND Corporation; 

- Representatives from each NAS design, through New American Schools; and 

- Educational Research Service. 

AJR focused its review on research that had been conducted within the past 10 years. However, we expanded 
the range of years covered when an approach remained largely unchanged and the bulk of research related to the 
approach was older. 

Developer Interview 

Interviews were conducted with developers or developers’ staff for each of the 24 approaches using the 
following questions.^ Interviews lasted approximately 30 minutes and were conducted after reviewing background 
material on the approach, but before reviewing the research. The questions asked in the interview are listed. 



Guide to Developer Interview 

1 . Rationale Underlying the Approach 

a. Please describe the rationale or theory underlying the approach. 

b. Please describe the goals of the approach with respect to student-level outcomes (e.g., achievement, enrollment, 
or affective outcomes). 

c. Please describe the goals of the approach with respect to school-level outcomes (e.g., school climate). 

2. Background Information 

a. Describe briefly what happens in the classroom when the approach is used. 

b. Which subject areas are included in the approach? 

c. Which children is the approach directed toward? 

d. How many children can one teacher serve with the approach in a school period? 

e. How long has the approach been used in schools? 

f. How widespread is the use of the approach (i.e., approximate number of schools and districts 
implementing the approach)? 

3. Description of Components of the Approach (For each component, specify if it is critical to the success of the 
approach.) 

a. Time and Scheduling Requirements critiad not critical not rdeuant) 

1. What are start-up time requirements for the approach? 

2. Please describe the start-up process (e.g., whole-school, gradually phase in, pace of phase in). 

3. How many days of the school year is the approach to be used? 

4. How many minutes of instructional time are devoted daily to using the approach? 

5. Hovi^ many sessions (days/ minutes) of the approach are t)^icall)^ necessary to achieve educationally 
significant effects? 

6. What are the unique scheduling requirements? 

b. Placement and Grouping Requirements critical not critical not rdeuant) 

1. How are children to be grouped for instruction? Whole class, small group, or individually? 
Homogeneously or heterogeneously? 

2. How many children are to be in groups? 

3. Does grouping transcend classroom boundaries? 

4. Describe procedure for determining instructional/developmental level of students. 

c. Staffing Requirements critical not critical not rdeuant) 
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1. Are additional personnel required in addition to existing classroom teachers? Specify the number of 
personnel, in which grades, and what qualifications and certification levels they should have. 

2. Is there a limit to the number of children per classroom? If so, what number? 

d. Instructional Materials critical not critical notrdeuant) 

1. Specify the instructional materials needed for each classroom. 

2. Specify the source(s) of materials (e.g., developers, other publishers, teachers). 

3. Specify how much and what kinds of instructional materials teachers are expected to create/ develop. 

4. Are appropriate materials available for children whose primary language is other than English? If yes, 
describe materials and why th^ are appropriate. 

e. Professional Development critical not critical notrdeuant) 

1. Inseruice training— prior to students be^nningsdxx)lyear. What are the requirements for staff development 
prior to staff beginning to teach the approach (e.g., summer training)? Describe how many hours of 
training are required prior to each of the first three years of implementing the approach. 

2. Inseruke training— durir^ school year. What are the requirements for staff development during the school 
year? Describe how many hours of inservice training are required during each of the first three years 
of implementing the approach. 

3. In-doss coaching. Js in-class coaching part of the approach? If so, how much coaching is to be provided 
for each teacher during each of the first three years of implementing the approach? 

4. Professional deudopers. Please describe the source(s) of professional development (e.g., developer, 
regional center, professional organization, contractor, district). What are the qualifications and 
availability of trainers/consviltants who provide professional development? 

5. Technical assistance. What other forms of technical assistance are available, and from what source? 

f. Monitoring of Student Progress and Performance C critical notcritical notrdeuant) 

1. Does the approach include ongoing monitoring of student progress and performance? Describe 
monitoring procedures. 

2. Does the approach provide remedies when student progress (and/ or performance) is inadequate? 
Describe procedures. 

3. Are there provisions for accelerating high-achieving students? Please describe. 

4. Does the approach target any particular category of students (i.e., by SES, region, ethnicity, disability 
status, level of schooling, etc.)? Please describe. 

g. Adniinistrative Support (_ critical notcritical notrdeuant) 

1 . What are the critical elements of support needed from the principal? 

2. What are the critical elements of support needed from the central administration? 

h. Family or Community Involvement critied notcritical notrdevant) 

1 . Please describe the family or community involvement called for by this approach. 

i. Please describe other critical components of the approach (e.g., peer involvement, computer technology). 

4. Cost of Approach (These data should be gathered in interviews with approach developers, independent 
research reviews, and, if necessary, random calls to sites implementing the approach.) 

a. What are the extra costs associated with the approach for the first year of implementation? (Specify how 
many students the costs are for.) 

1 . Additional personnel— Roles/ tides, full-time, part-time. 

2. Materials— Required and supplementary, please describe. 

3. Staff Development— Release time, stipends, travel/per diem, trainer, fees, other expenses. 

4. Other Costs. 

b. What are the extra costs for subsequent years? 

1 . Additional personnel— Roles/ tides, full-time, part-time. 

2. Materials— Required and supplementary, please describe. 

3. Staff Development— Release time, stipends, travel/per diem, trainer, fees, other expenses. 

4. Other Costs. 

5. Information on Implementation^ 

a. What information on implementation requirements and procedures is available to schools considering 
using this approach? (Select one.) 

1. General description of approach requirements. 
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2. Non-detailed description of implementation requirements of the approach, including at least some of 
the following: staff development, curriculum, instruction methods, materials, and assessments. 

3. Specific description of implementation requirements and procedures of the approach, including all of 
the following: staff development, curriculum, instruction methods, materials, assessments, and costs. 

b. What information on costs is available to schools considering using the approach? (Select one.) 

1. General information about approach costs. 

2. Estimated cost of approach, mcluding whether or not costs of materials, staff development, additional 
personnel, etc. are included in the approach’s purchase price. 

3. Specific costs of the approach, including whether or not costs of materials, staff development, 
additional personnel, etc. are included in the approach’s purchase price. 

6. Replication of Implementation 

a. How stable and widespread is approach implementation? (Select one.) 

1. Not fully implemented at the original site. 

2. Fully implemented in the original pilot site(s) for a minimum of one school year. 

3. Fully implemented in the original site(s) for more than three years. 

4. Fully implemented in multiple sites for more than three years. 

b. How many additional schools are expected to implement the approach according to the developer? 

1. 1998-1999 

2. 1999-2000 

3. 2000-2001 

4. 2001-2002 

5. 2002-2003 

7. Request Materials and Sites 

Thank you very much for taking the time to talk about (approach). Thank you, also, for freeing to send the 
materials we’ve requested. I have just two more requests. First, could you recommend articles and evaluations of the 
approach that we could read? Second, could you please give us a list of all of the sites that are implementing your 
approach, with contaa names. 



School Interviews 

AIR conduaed telephone interviews with staff at three to five randomly selected schools that had adopted each 
approach. A greater number of sites were chosen for those approaches that were more widely used. In addition, 
schools were chosen that were not in their first year of implementation. Fifteen-minute interviews were conducted 
using the following questions. 



Guide to School Interview 

1 . How long has your school been using this approach, and why did your school select this particular approach? 

2. In your opinion, what are the strengths of this approach? 

3. Do you have any concerns regarding this approach? 

4. (a). Has your school made any adaptations to the original design of the approach provided by the developer? 

(b) . Can you provide an example of a recent adaptation to the developer’s original design? [If answered “yes” 

to question 4(a).] 

(c) . Wlty' did your school decide to make that particular adaptation? 

5. (a). How did you begin implementing this approach in your school? [i.e., all at once, over time] 

(b). What do you think were the benefits and disadvant^es of this styie of implementation? 

6. (a). In your experience, is this approach equally effective for all of your students, or have you found it to be 

more/less effective with some? [i.e., gfited and talented students, special needs students] 

(b) . If there is a difference, what do you think explains that difference? 

(c) . Is this approach equally effective for all types of schools and school districts? 



7. (a). Do you think most of your teachers share your feelings concerning this approach? 

(b) . If not, why not, and what do you think would help your teachers to use the approach more effectively? 

(c) . Has this approach either helped your teachers to work more cooperatively or created/ exaggerated 

differences among staff? Please describe. 

(c^. Have staff attitudes concerning this approach changed over the course of the time you have been using it? 
Please explain. 

8. (a). Discuss the costs of the approach. Namely, what are the extra costs associated with the approach for the 

first year of implementation? (Specify how many students the costs are for: ). 

1 . Additional personnel— Full and part-time 

2. Materials— Required and supplementary 

3. Staff Development— Release time, stipend, travel/per diem, trainer, fees, other expenses 

4. Other Costs 

(b). What are the extra costs for subsequent years? 

1 . Additional personnel— Full and part-time 

2. Materials— Required and supplementary 

3. Staff Development— Release time, stipend, travel/per diem, trainer, fees, other expenses 

4. Other Costs 

9 Are your school's costs the same now as when you first started using this approach? If not, what is the same 
and what is different? 

10. Given a second chance, would your school spend its money in the same maimer, or have you learned things 
while using this approach that would lead you to spend your money differently? 



’SOURCE: National Center to Improve the Tools of Educators, 1998. Evaluation of research on educational approaches 
(EREA). Eugene, OR: Author. 

^ AIR used materials the developers provided to answer these questions. 
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Appendix H 

Response Letters from Developers 



Developers were asked to review one or more drafts of the information the report presents for their 
approach (i.e., profiles, ratings, and appendices). In addition, AIR invited the developers to submit a two- 
page “feedback” letter if they wished. Twelve developers accepted AIR’s invitation and submitted written 
comments. 

• Accelerated Schools 

• America’s Choice 

• ATLAS Communities 

• Audrey Cohen College: Purpose-Centered Education 

• Basic Schools Network 

• Community for Learning 

• Different Ways of Knowing 

• Foxfire Fund 

• Modern Red Schoolhouse 

• Paideia 

• Success for All/Roots and Wings 

• Urban Learning Centers 

These comments are reproduced in this appendix. They include letters; statements or Fax transmittals 
that were part of longer documents, usually the developers’ suggested changes in the profile for their 
approach; and brief statements. 

Some developers raised specific concerns about the profiles or ratings; others offered general comments 
about their approaches or about this report. AIR received written comments from eleven developers in time 
to address their concerns. Comments from one developer were received after the report had been finalized. 
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Stanford University, Stanford, California 94305-3084 



HENRY M. LEVIN 
David Jacks Professor 
OF Higher Education 



School of Education 

(415) 723-0840 
(415) 723-7578 FaX 



22 September 1998 



Ms. Becki Herman 
Project Director 

American Institutes for Research 
Pelavin Research Center 
1000 Thomas Jefferson Street, NW 
Washington, DC 20007 

Dear Ms. Herman: 



This letter follows up my conversation with you of today. Overall I think that you have 
done a good job on this report. However, I think that you have under-rated the 
Accelerated Schools Project by your methodology. I acknowledge that I am a 
“developer”, but I am also a highly recognized evaluator. I am also the former President 
of the Evaluation Research Society (which is now the American Evaluation Association), 
Past-Editor of the Review of Educational Research, and author of the most widely used 
book on cost-effectiveness analysis in education. 

The under-rating of the Accelerated Schools results is due to: 



1- No consideration given to the large number of year-to-year gains from official records 
of schools and school districts cited in our Accomplishments of Accelerated Schools 
and documented in footnotes as to source. Although these are not experimental 
studies, they are documented results which should count for something. For example, 
if PS 108 in East Harlem. New York has moved over three years from about 36 
percent of students at or above grade level in math and reading to 61 percent at or 
above grade level in reading and 68 percent at or above grade level in math on CTBS 
(a school with a 93 percent poverty rate and 100 percent minority), shouldn’t this 
have some weight? What if we have evidence of dozens of schools with this kind of 
result? Should Uie lack of a formal study mean that this kind of evidence is 
worthless? 



2- Virtually all studies comparing “experimental” schools to control or comparison 
schools are not as rigorous as that sounds. The reason is that the two groups of 
schools are not chosen randomly, but the treatment school in almost all of the reforms 
must get an 80 percent buy-in while the comparison school does not have to show any 
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ambition whatsoever. Simply measuring results at the comparison school does not 
mean that it is comparable in ambition, staffing, and commitment to student 
achievement. And remember that the developer chooses the comparison school, not 
an outsider. 

3- Use of one’s own achievement measures that are aligned to one’s reform will get 
results that are not found in more “neutral” testing. For example, see Ross and Smith 
(1994) Elementary School Journal, pp. 121-138 for results on the developers test, but 
not on district tests. All Accelerated Schools results are on whatever tests districts 
require, not on the kinds of gifted and talented criteria which we are dedicated to. 

4- In an evaluation by Success for All evaluators in the State of Washington using SFA 
measures of outcomes and first year results which do not favor our project which is 
developmental and doesn’t look for results until the third year. Accelerated Schools 
got slightly better results than Success for All. Using Peabody Picture Vocabulary 
Test as a control, the two projects showed no difference on oral reading, word 
identification, and passage comprehension. But, SFA had a .28 effect size advantage 
on word attack and ASP had a .41 advantage on writing. At the very least one could 
argue that ASP has at least comparable results with SFA in a direct comparative 
evaluation (even when the measures and timing would have favored SFA criteria 
rather than those of ASP). I have enclosed the study. 

I would hope that based upon this information you can reconsider the “marginal” 

effectiveness that you gave to Accelerated Schools. 




Sincerely, 



Henry M. Levin 

David Jacks Professor of Higher Education and Economics 



cc. Jennifer Stephens 
Kari Marble 



October 5, 1998 



Comments on the AIR Study of Comprehensive School Reform Approaches 

from the 

America's Choice Design Team 

We welcome the AIR study and others on this topic as beginning contributions to what we 
hope will be a growing literature on comprehensive school reform. But this particular 
study is, we believe, deeply flawed. The study rated the programs on four dimensions. 

We will comment on the way each of these ev^uations were apphed to the America s 
Choice Design. 

Strength of Research Base Generally, when this term is used, it refers to the quality and 
extent of research findings on which the design is based. The question being answered is 
whether and to what degree the design is based on what is actually known about the factors 
that account for high student performance. 

Our design is in fact based on extensive reviews of the research in the m^y fields that are 
covered by the design, including learning theory (one of the nation's leadmg cognitive 
scientists is associated with our team), standards and assessments (in which we are among 
the nation's leading authorities), curriculum (with particular attention to reading and 
writing) and modem management. Our own organization has done one of the most 
extensive qualitative international comparative studies of education ever undertaken. And 
we have had our design reviewed by several eminent researchers to make sure that it 
reflects the best research. 

Ideally, of course, we would have undertaken a formal comprehensive meta-study of the 
many research fields that bear on our design. AIR appeared to have been looking for such 
a study or for original research by the design team. But neither New American Schools nor 
the foundations that have supported our work asked us to prep^e such studies or do such 
research nor did they provide the funds that would have made it possible. 

Rffects on Smdents The America's Choice Design incorporates a commitment to the 
New Standards Performance Standards and the New Standards Reference Examinations, 
which have been available for less than two years. Because, therefore, we did not have 
available comparative data based on our own standards and assessments, we asked 
jurisdictions with which we have been working to share the data they had on whatever tests 
and assessments they were using. There is space here for only three examples: 

In Chicago, where we had been asked to take on 13 of the city's worst-performing 
elementary and middle schools, the percentage of third and eighth grade students scoring at 
or above the national norms on the Iowa Test of Basic Skills rose from 14.6 percent on 
average when we started in 1996 to 19.9 percent in 1998 in reading, and from 16.4 percent 
to 23.6 percent on average in the same period in mathematics. 

In Rochester, New York, where we were working with three elementary and middle 
schools, the average proportion of students meeting the standard on the statewide reading 
tests went from 69 percent to 90 percent from the 94-95 school year to the 96-97 school 
year. That proportion went from 92 percent to 98 percent in mathematics. 

After our first year in Kentucky, State Commissioner of Education Tom Boysen announced 
that the schools associated with our design had made greater gains on the statewide 
assessment than the schools associated with any of the many other outside technical 
assistance networks operating in the state. 
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We supplied data of this kind to AIR. But AIR evidently did not consider it in arriving at 
their judgments because it did not come in the context of formal research studies using 
"carefully matched control groups" and so on. 

In any case, since our standards and assessments are now available and our work has been 
fully codified into a formal design, we have asked CPRE, arguably the nation's leading 
educational program evaluators, to evaluate and report on the implementation and effects of 
the America's Choice Design. That work begins in the fall of 1998. 

In the meantime, we would be happy to share the data we have from our school, district 
and state partners on the effects of our work thus far. 

Ease of Implementation Unfortunately, the AIR researchers apparently did not have an 
opportimity to ask our school, district and state partners what it has been like to work with 
us and how easy it has been to implement our design. Here is a typical comment from Dr. 
Judith Rizzo, Deputy Chancellor, New York City Public Schools: 

"We like your standards. It begins there but doesn’t end there. Most of what 
we’ve purchased is your expertise and thinking and talent to move, I think, in the 
direction we want to take the system. The quality of the standards was the most 
compelling feature, as weU as the NCEE’s willingness and understanding to 
customize them to make them feel and smell like New York City kids’ work, 
which was an absolutely essential ingredient. The quality of the NCEE’s 
professional development work that occurred during the process was the best I’ve 
ever seen. It embodied aU of what I know good solid professional development 
to be. It modeled for our participants the kind of behaviors that we have to 
demonstrate in order to get kids to achieve the standards. Because it is 
experiential, it did this in ways that my own words could never have done. My 
testament is the fact that we continue with the work, in math and applied learning. 

Ann Borthwick is the most sought-after consultant I’ve ever seen in this system. 

She’s practically part of the system. She couldn’t be more invested in our system 
if her paycheck had the name of the Board of Education on it. Consultants come 
and go, but she’s staying in town. The superintendents adore her." 

The highest score one could get on the AIR scale requires successful implementation in 
only five schools. There are hundreds of schools in our network and we would be happy 
to point any interested party to more than five of them in which the faculty members would 
attest to the strong and effective implementation support they received from the America's 
Choice team. 

CqsI? The AIR report showed our design as being on the high end of the expense 
dimension, when all costs are accounted for. That may or may not be true; we simply do 
not know, because we are not privy to the data that they used to make this determination. It 
is true that it actually costs participating schools more than we charge. The most expensive 
part of the additional charges is the cost of the faculty members whose time — in whole or 
in part — must be dedicated to implementation of the America's Choice Design, like, the 
Literacy Coordinator. The reality is that, in most cases, these are faculty members already 
on the staff who are redirected to this work from similar work that they are already doing, 
like Title I teachers or reading resource teachers, so there is no net additional cost for the 
school. Because we do not know how the AIR team treated these expenses, we cannot 
comment on its accuracy. 
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October 6, 1998 

Response from ATLAS Communities 



ounded from a Partnership of 
loalition of Essential Schools 
ducation Development Center, Inc. 
larvard Project Zero 

Ichool Development Program 
at Yale Child Study Center 



We welcome the opportunity for practitioners to learn about 
ATLAS Communities. However, we believe it is important that 
your readers understand the special nature of the ATLAS 
approach. It is a framework for transforming a preK-12 pathway of 
schools. It is a journey for the schools that agree to participate in 
ATLAS; to assess strengths and needs, learn about the components 
of the ATLAS framework, develop implementation goals, 
benchmarks, and plans, and move through the iterative cycle of 
planning, action, and reflection. Because the ATLAS ideas, tool, 
and strategies build on the expertise and wisdom that already 
reside in every school and district, no two pathways look exactly 
the same. 



ducation Development Center, Inc. 
5 Chapel Street 
lewton, MA 02158-1060 



The following vignette highlights the power of the ATLAS 
framework; 



117-969-7100 
AX: 617-969-3440 
;-MAIL: atlas@edc.org 
tfww.edc.org/FSC/ATLAS 



"For many teachers and principals, education reform 
has become a confusing whirlwind of unconnected 
initiatives. One day the faculty is trying out team 
teaching, the next day they're learning about project- 
based lessons. It's all very exciting, but is the end 
result improved student achievement? 



Too often the answer is no, because the staff lacks a 
coherent way to tie new techniques into a meaningful 
coordinated push. At Memphis' Booker T. 
Washington High School, Principail Elsie Lewis Bailey 
confronted this issue. 



"We had been using new strategies here and there, as 
we read about them, or read what another school had 
done," Bailey recalls. The ATLAS design ended her 
piecemeal search for new ideas and practices, giving 
Bailey and her teachers a ready-made, research-based 
organizing framework."* 

"With ATLAS, we don't have to look for strategies. 
ATLAS has given us an entire framework around 
which to base our instructional program." 

Elsie L. Bailey, Principal 



* from New American Schools - Armual Report 1997 
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Unlike many approaches, ATLAS did not exist prior to 1992. In 1992, the four founders 
of ATLAS, Ted Sizer from the Coalition of Essential Schools, Howard Gardner from 
Harvard Project Zero, Janet Whitla from the Education Development Center, and James 
Comer from the Yale School Development Project, had a vision that they could meld the 
strengths of each of their programs to create a truly comprehensive approach to school 
improvement. ATLAS is a continuing embodiment of that vision. Therefore, ATLAS 
today is very different from ATLAS in 1993. Not different in the overarching 
framework of a pathway, fundamental principles and habits, or in the elements of 
school change-but in the way we approach our work, in the materials we use, and the 
resources we provide. And ATLAS in 2003 will be different from ATLAS today. 

Because ATLAS is a continuing evolving framework for improvement, there is not a 
wealth of research, as defined by AIR, to provide evidence of student effects, the 
ultimate outcome. The AIR definition of research base and effectiveness implies that a 
traditional study of student outcomes with control groups is necessary. Because 
ATLAS requires a high magnitude of teacher change, ATLAS schools are only now 
developing a large enough cohort of teachers to look at student outcomes in a more 
systematic way. ATLAS is developing a research plan to engage in such research 
beginning in the 98/99 school year. 

However, we and our pathways do have evidence that ATLAS has been making a 
difference. The implementation of the ATLAS framework in schools across the country- 
-in both urban and suburban districts-has led to marked improvements in school 
culture, and significant changes in instructional methods, student habits and outcomes. 
Standardized test scores have increased in all pathways that have worked with the 
ATLAS framework for three years or more. Students and teachers in all pathways 
report that students are more interested in their schoolwork. Students comment that 
their work is different in nature, that they are learning more, and that their successes 
are more rewarding. 

A teacher said that ATLAS taught the district that professional development is "not 
workshops on this or that," but an understanding that the educational process is 
complicated and connected, so that professional development becomes not a matter of 
"pinpointing an issue," but of "learning from each other." In Gorham, family 
participation in student-led learning conferences is nearly 100 percent. Family Centers 
have been established in several pathways, and many parents are being trained as 
school volunteers. 

In Memphis, the high school scores on ninth-grade state assessments for reading and 
math improved for the fourth consecutive year. In Prince George's County, reading 
scores jumped 13 per cent in two years. In Norfolk, there was a 15 per cent increase in 
achievement tests for research, writing and science-all areas directly related to the 
eleventh grade exhibition tasks. Norfolk scores also improved in middle school 
reading, writing and mathematics. In Philadelphia, four Strawberry Mansion cluster 
schools exceeded performance targets after two years of ATLAS implementation. 

ATLAS Schools are making a difference for their children. 



AUDREY COHEN COLLEGE 



Office of the Vice President 

Octobers, 1998 

Ms. Becki Herman 
Project Director 

American Institutes for Research 

Pelavin Research Center 

1000 Thomas Jefferson Street, N.W. 

Washington, D.C. 20007 

Dear Ms. Herman: 

We are in receipt of the draft copy of the American Institutes for Research (AIR) summary of comprehensive school 
reform approaches. Judging Schoolwide Reform: A Teacher and Administrator Guide to 26 Noteworthy 
Approaches. We appreciate the opportunity you have provided to dispute the rating as it relates to the Audrey 
Cohen College System of Education. We do agree with your statement which says that, “a very conservative rating 
procedure was used to complete the overview table”, and do firmly believe that your approach did not result in the 
rating that Purpose-Centered Education‘s deserves. We are therefore obliged to respond to the summary you have 
provided and address several areas where, in our opinion, inappropriate judgments have been made by AIR. 

Since the College was founded it began developing a new paradigm for education. Emerging from a number of 
years of research on the educational implications of the changing economy and reflecting the perception that the 
emergence of a technologically based global society required a fundamentally new approach to learning, a new 
educational paradigm was developed by the College. Bom as the College’s new paradigm, Purpose-Centered 
Education* focuses all student learning — from mathematics and science to English and social studies — on a 
complex and meaningful, overarching Purpose each semester that contributes to the world at large. 

Audrey Cohen College Schools have been implementing Purpose-Centered Education, on the elementary and 
secondary levels, across the country and monitoring student academic progress from the inception of the use of its 
paradigm in grades kindergarten through grade twelve. The College annually publishes Signs of Success, which 
contains comparative data on academic and related student progress. Standardized test scores in reading, 
mathematics, and language show an overall improvement during the years that Audrey Cohen College 
Schools have implemented Purpose-Centered Education. Students take greater charge of their learning and 
value their knowledge as an essential ingredient in achieving success as they are assessed in how they have made 
positive differences outside their classroom. Where attendance was a concern or discipline problems were a 
challenge, attendance improved and discipline problems decreased. Students in Audrey Cohen College Schools use 
knowledge - including the core subjects of mathematics, science, history, English/Language Arts and geography - as 
they take Constructive Action® to improve their communities. 

The AIR judgement related to the “Effect on Students”, is limited. For example, the studies conducted by the 
Mississippi State University’s Program for Research and Evaluation (PREPS) ranked an Audrey Cohen College 
School located in Hollandale, Mississippi second, in the twenty-six of the one hundred tltty-two school districts 
statewide that have made a difference in instruction. PREPS takes into account the district’s economic levels not 
considered in the state’s accreditation system which is based on test performance. In addition, the trends at this 
Audrey Cohen College School, from the 1994/95 through 1996/97 school years, showed the ITBS total reading 
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scores increased an average .95% in grade 4, 22.5% in grade 5 and 7.88% in grade 6. During the same years, 
scores on the ITBS language scores increased an average 8.23% in grade 4, 20.61% in grade 5 and 13.73 % in 
grade 6 and on the mathematics portion of the ITBS scores increased an average of 8.29% in grade 4, by an average 
1 1.04% in grade 5 and by an average 5.12% in grade 6. 

Furthermore, in the ITBS Batteries for grade 5 and grade 6, this school ranked and 4^^ respectively statewide, with 
the fewest number of students in the lowest quartile and 10^*’ in the state in “attendance as % of enrollment” at 
98.07%. Other schools using Purpose-Centered Education have made similar or greater gains. For example, one 
Memphis City School by the end of the second year of implementing Purpose-Centered Education, grade 8 scores 
on the TCAP Writing Assessment increased by an average of 34.25%, and grade 1 1 scores increased by an average 
of 381.7%. During the same period, students in grade 9 showed an average increase of 3.42% in mathematics on 
the TCAP Competency. Simultaneously, the number of suspensions decreased by 16.1%. 

In another Audrey Cohen College School located in Seattle, Washington, which began using Purpose-Centered 
Education in the 1996/97 school year, grade 3 scored 6.65% higher than the district for “students who did not meet 
either the ‘advanced’ or ‘below standard’ level”. Grade 5 was 22.3% higher than the district for “within standard” 
level of performance on the Direct Writing Assessment. This represents an increase of 60.1% in Grade 5, from the 
prior year. Also in the 1997/98 school year, this school’s grade 3 scored 97.4% higher than the district for students 
who were in the “advanced level” of performance for the Direct Writing Assessment swmmdLVy. This represents a 
61.5% increase over the prior year. 

We believe that the substantial and overall consistent upward trend in scores as evidenced by the results of a range 
of standardized tests clearly attests to the effectiveness that Purpose-Centered Education has on students in Audrey 
Cohen College Schools. 

The standard research notions that were used by AIR to judge Purpose-Centered Education unfortunately do not 
take into account the longevity of the use of the design kindergarten through grade twelve. Voluminous 
inaccuracies are present in the draft version of Judging Schoolwide Reform: A Teacher and Administrator Guide to 
26 Noteworthy Approaches. We encourage members of the American Association of School Administrators, 
American Federation of Teachers, National Association of Elementary School Principals, National Association of 
Secondary School Principals, National Education Association and any other interested parties to contact Audrey 
Cohen College directly for ftirther current and accurate information as it relates to research and implementation. 



Sincerely, 




212-343-1234 extension 3400 

JanithJ@aol.com 

http://www.audrey-cohen.edu 
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The Basic Schools Network 

Dr. Mary Ellen Bafumo, Director 
Addendum Statement 

As the Basic School Network awaits the results of its three year pilot school 
evaluation, preliminary results are ovenwhelmingly positive. 

• 4 schools were identified as exemplary for their standardized test score 

achievement: 1 . David Cox Road Elementary, Charlotte, North Carolina 

2. Jackson-Keller Elementary, San Antonio, Texas 

3. Public School 7, New York City, New York 

4. Willard Model School, Norfolk, Virginia 

• Willard Model School students, predominantly African-American, had test 
scores that surpassed the national norm for non-minority students 

• Public School 7, in New York’s Spanish Harlem, was removed from the State’s 
SURR list (school under registration review) in the 1 Va years it has been a Basic 
School, - a fraction of the normal time for improvement. The New York Times 
ran a headline about P.S. 7's news. Principal Robert Negron noted, ”Our 
progress would not have been possible without our model of excellence. The 
Basic School.” 

• Irving Weber Elementary Teacher, Gina Rau, received a national award from 
the Subaru Corporation for the service project she conducted with her classes. 

• Clinton Kelly Elementary in Portland, Oregon was cited by the U.S. 
Department of Education for its model parent involvement program - “Kelly 
House.” 

• Prairie Star Elementary in Leawood, Kansas and Mantua Elementary in 
Fairfax, Virginia have consistently had high test scores among their student 
populations. 

• State Departments of Education in California, Connecticut, Michigan, New 
York and Texas are interested in the Basic School as a model for their schools 
in need of improvement. 

• Evaluation results show that the Basic School has these positive effects: 

1 . Provides schools with a common language and focus 

2. Is responsive to diversity, is open and flexible 

3. Creates cohesiveness, reduces teacher isolation 

4. Involves and empowers teachers, parents, students, communities 

5. Creates an exemplary culture in the school 

6. Provides intangibles (caring culture) that improve test scores, 

discipline, absentee rates 

Schools interested in renewal can be assured that the activities of the Network 
were developed using years of research on effective schools and best educational 
practices. The research base for the Basic School Network’s four priorities for school 
renewal are extensively documented in Ernest L. Boyer’s report. The Basic School: A 
Community for Learning, available through Jossey-Bass., Inc. Primary researchers and 
practitioners whose work informed the concepts in the report are listed below. A 
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M.E. Bafumo, Basic School Network 



reading of any of their works demonstrates rigorous scholarship and deep engagement 
in practice. 

Research Base 



Community: 



Thomas Sergiovanni. 



Curriculum: 



Climate: 



James L. Bean 
Heidi Hayes Jacobs 
Susan Drake 

Robert Slavin 

David and Robert Johnson 



Character: Thomas Lickona 

Kevin Ryan 
Eric Schaps 

Parent Involvement: Joyce Epstein 



Pilot schools in the Basic School Network completed extensive parent, teacher, 
principal surveys to collect base-line data in year one of the project and for two years 
after that. Results showed progress in each of the four priorities for renewal. Some 
pertinent results are listed below. 

Survey Data 1995-1997 



• high ratings for parent -teacher, teacher-student relations 

• the school’s climate is respectful and welcoming to children, parents, teachers 

• teachers are perceived as knowledgeable, skilled role models for children 

• many programs exist to meet the social, emotional & learning needs of children 

• high levels of teacher satisfaction 

• high levels of parent satisfaction 

• high use of community resources to expand learning opportunities 
o many business partnerships to enhance resources in the school 

• classrooms that are well supplied with learning resources 

• increasing levels of technology use in classrooms 




TEMPLE UNIVERSITY 
A Commonwealth University 



Center for Research in Human 
Development and Education 



9th Floor, Ritter Annex (004-00) 
Philadelphia, Pennsylvania 19122 
(215) 204-3000 
Fax: (215) 204-5130 



October 29, 1998 



Becki Homan 

Project Director, Consumer’s Report 
American Institutes for Research (AIR) 

100 Jefferson St.,NW 
Suite 400 

Washington, DC 20007 
DearBecki: 

Thank you for the chance to provide feedback on the information you and your colleagues have developed 
for our program. There is voluminous program validation research and evaluation documentation of field-based 
implementation and replication spanning over twenty years of evolving research and development of the 
Community for Learning (CFL) program. We greatly appreciate the time you and your colleagues have taken in 
reviewing the research based on the design and implementation outcomes of our program. 

The purpose of this letter is to call attention to two areas of strength in the research base of our program 
that wCTe not adequately portrayed in your analysis. We fully appreciate and understand the time and space 
constraints and the difficulty deciding how best to focus your review. 

First, the development of our program has evolved since 1968. The design of each component of our 
program was based on field-based research that has gone through iterations of validation studies. Although the 
validation research on the Community for Learning as a school-wide comprehensive school reform model began in 
the 90's, the implementation research of the core instruction program, known as the Adaptive Learning 
Environments Model (ALEM), began in the late 60*s. This research has been extensive and the findings have been 
published in some of the most rigorously peer-reviewed research journals, such as American Educational Research 
Journal Child Development, Contemporary Educational Psycholo^, Curriculum Inquiry, Elementary School 
Journal Research in Middle Level Education Quarterly and Review of Educational Research. In addition, the 
research has also been published in some of the most widely read, policy- and practitiono’-oriented journals, such 
as Educational Leadership, Education and Urban Society, KAPPAN, Journal of Teacher Education, Educational 
Policy, Policy Studies Review^ and Teacher Education and Special Education. 

Secondly, there is a lack of attention and understanding of the broad-based component-building research 
that led to the comprehensive school-wide implementation of the Conununity for Learning program. A major 
strength of the research base of our program is a systematic process of development and vahdation of each of the 
critical components of the program and intensive study of program ‘Teasibility^’ and “effects.” One example is our 
validation research in the development of the degree of program implementation measures, which is the basis for 
the databased professional development program that supports school-based implementation of the Community for 
Learning program. This empirical research was published in Curriculum Inquiry^ one of the most rigorously peer- 
refereed journals. Although it was not selected for review, it was one of the most important component-building 
research bases of our program — implementation requirements for achieving a high degree of program 

One area of conc^ in the section on the research base included in your report is the lack of attention to 
the implementation variables that we beheve to be central: to effective and widespread implementation of aity 
innovative program that requires major rethinking and restructuring in the ways schools operate. For example, a 
critical aspect of the implementation is the use of teacho’ and student time. The research on how to organize the 
classroom and school day to enable teachers to spend more time for teaching and learning was an area of special 
attention in the development of the Community for Learning program. This research was pubhshed in American 




428 





Educational Research Journal The study included 156 teachers from across 10 school sites from rural, urban, 
suburban and small town schools with student populations ranging from low to middle SES backgroimds. The 
data included classroom obsovations of time use by teachers as well as student achievement outcomes. Your 
reviewers rated “2” on this cross-sectional analysis study for “duration” and “1” on the study design. 

In anotha* study on time use, the reviewer completely misses the main point of the study, which was an 
article published 'mRemedial and Special Education on a study of days to learn. The ndiole point of the study was 
to show that |11 students can learn, though some may take more time than othoa in achieving the same curricular 
objectives. They don't need to be labeled to receive intensive instruction and to allow greater amounts of learning 
time. The conclusion of the study shows clearly that students labeled as special education and Title 1 students were 
able to acquire mastery of the same curriculum objectives as students in “general education” without “special” 
labels. However, your review concluded from this study of time and student learning that the program is not 
effective, because special education and Title 1 children took more days to achieve mastey of the same curriculum 
objective. It does not require rocket science to validate that some childroi require mcve time fra* learning certain 
objectives than others; variation even exists in the most homogeneously grouped students. The main goal is to find 
ways to ensure that every student has an equal opportunity to achieve mastoy, rriiedier he m: she needs more time 
(X more intensive instructioa Thus, the jH-ogram is effective because students with diverse needs are able to meet 
the same curriculum standards. 

I note these illustrations to call attention to the complexity of providing a synopsis of a program that is 
designed with a “comprehensive” approach. The nature of teing “comprehensive” encompasses addressing not 
only the powerful teaching of subject matto*, but also all of the support systems, including family and community 
effinfs that are necessary to ensure learning success of each student A major strength of the research-base of our 
program is the attention to school-based implementation that provides teachers and adminis trators with the support 
system to ensure effective implementation. This is critical in providing the org anizati onal and structural support fix' 
maiutging the classroom environment to provide students with responsive strategies that fosto-, not only high 
standards of subject matter achievement, but also the development of their self-responsibility and capacity fix 
exploration and learning beyond the basic literacy skills. 

Many of our research studies on program components were not reviewed ex reviewed out of context I 
mention these concons not to be oitical of the oiteria you have chosen fix your review. As the reviewer, you had 
to make decisions based on consideration of the wide span of {xograms. Some are specifically focused on 
curriculiun, and others like ours are much more comprehensive in addressing the schooling needs of children and 
youth. Having recently completed a research synthesis on widely implemented research-based programs 
(published in the April, 1998 issue of Educational Leadership), I imderstand and respect decisions that were 
necessary to make sense of the vast research base of the programs you reviewed. I hope my illustrations provide 
anotho* view of program evaluation that may be informative fix the readers. 

Finally, I congratulate you and your colleagues fix taking on this enormous task and providing a timely 
service to the field. I am sure this will be a widely used reference for teachos and administratexs in making their 
programming decisions. I know we at the Laboratory fix Student Success, the Mid-Atlantic Educational Ri^onal 
Lalxxatcxy at Temple Univosity Cento* fix Research in Human Development and Education, will cer tainly find 
this a useful tool in our efforts to provide research-based information on innovative practices and programs that 
work fix educatrxs and policy mako^ in their state and local reform effixts. 

My best wishes fix your continuing success. 



MCW/mam 




/ang 

Professor and Directex 




429 



January 22, 1999 



Dear Colleagues, 

Thank you for your interest in the research on Different ]Nays of 
Knowing. 

We have ongoing studies of the work in all our sites. Of particular 
interest to Title I schools are two new studies — One in 11 schools in 
the San Francisco Unified School District and the other tracking 83 
Title I schools in Kentucky. 

Students involved in Different Ways of Knowing in San Francisco 
represent the diversity of the District — 26% are Latino, 21% Chinese, 
16% African American, 13% White, 12% Filipino, 11% Other Non- 
White, and 1% Native American. 

The District measures of academic success show that students 
engaged in Different Ways of Knowing have more than a year's 
growth in their scores in the CTBS test for reading comprehension — 
the students' mean Normal Curve Equivalent (NCE) increased 
significantly. The 1997 mean Normal Curve Equivalent for the 
fourth grade CTBS test in reading comprehension for students with 
matched reading scores was 48.39 (n=1248). By 1998 the mean NCE 
was 51.47. This difference is statistically significant. 

In Kentucky, a study examines our work with 83 whole school 
Title I elementary schools where 75 percent or more teachers 
implement Different Ways of Knowing. 

We've worked at scale in Kentucky for four years — reaching more 
than 5,000 teachers in 350 primary and elementary schools 
statewide. 
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The Galef Institute, Page 2 



The state's standardized test results — the 1997 Total Accountability 
Index (consolidating reading, writing, math, social studies, science, 
living, and arts and humanities scores) — shows that 61 of the 83 
schools achieved 90 percent or more of their two-year school 
improvement goal in one year. The 83 schools had test results 
ranging between 68.9 percent and 119.8 percent of their two-year 
improvement goal; 32 of them achieved 100 percent or more. 

The average percentage gain among these 83 Title I whole schools, 
after one year of the two-year cycle, was 96.5 percent. This compares 
with the average percentage gain of 46.6 percent of all Kentucky 
elementary schools in the same period. 

Given the strong correlation between student achievement and 
economic indicators, the results of both these studies are 
encouraging. They show that traditionally low-achieving schools 
can have dramatic improvement in test scores. The research 
demonstrates that quality results can be achieved in a wide variety 
of school settings. 



Cordially, 




ERIC 
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The Foxfire Approach: An Educational Framework 

The Foxfire Approach provides a framework, articulated by eleven Core Practices, 
which guides teachers’ decisions in the materials, methods, and strategies for use with 
their scents. We believe such decisions must be made within the context of the 
teaching environment. We know that we could never control or predict the variables 
that should and do affect what constitutes a good decision within the complex and 
individual cultures of the schools and classrooms. 

Research and the Core Practices 

Each Core Practice is supported by the findings of studies conducted by researchers 
over the years indicating that effective use of the practice will create powerful and 
productive learning. For purposes of demonstration, one classic study will be offered 
here. 

In 1929, McMillan published a report authored by Ellsworth-Collii^s titled “An 
Experiment with a Projea Curriculum.” The four-year study of three schools in 
Pineville, Missouri, included two control schools and an “ejqjeiimental school.” The 
pvpp rimpnr al school used the commumty as a learning laboratory, intentionalfy" 
blurring boimdaries between school and commumty. Students saw immediate use for 
the content under study by exploring questions and curriculum in the world outside 
the classroom walls. 

At the completion of the four-year study, standardized test scores of students in the 
pypp rimpri ral schools were 35% higher than those in control schools. Their 
attendance rose 93% as opposed to 6% in control schools, and 100% of students 
completing the eighth grade went on to high school, an 85% advantJ^e over control 
schools. Furthermore, the report pointed out, students in the experimental school 
developed qualities of initiative, judgment, and self-direction not evident in students 
in the control schools. 



Purposeful Research 

Because the Core Practices identify recognized effective teaching practices, the 
organizational questions we pose are “How effective are we in training and 
supporting teachers in the use of the practices?” and “What more can we do to 
strengthen our services?” 



Therefore, our research focuses on implementation— how teachers go about 
implementing the Core Practice, what barriers they face, what supports th^'^ believe 
they need, what points of entry they find most helpful, and how their needs change 
over time. To answer these questions, we use a three-pronged approach, including 
research conduaed by an independent firm; teacher accoimts of their experiences, 
i nrlu Hing teacher research; and study groups, task forces, and focus groups. 
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Independent Research 

Research conducted by Project Evaluation and Research Group of Cambridge, 
Massachusetts, explored the effectiveness of our introductory course, the first year of 
implementation, and the ways teachers’ use of the Core Practices change over time. 
The findings of these studies have been used to guide further stu(fy and exploration, 
as well as to prompt the development of new materials and support programs^ 

Teacher Accounts of their Experiences 

Written accounts of teachers’ experiences, including teacher research (which may 
include reports of student performance), are gathered from across grade levels, 
content areas, geographic regions, school settings, and school populations. As new 
materials and services are developed, these accounts are used to verify or challenge 
the findings of more formal outsider research. 

Task Forces. Focus Groups, and Committees 

Written and telephone surveys of network and national membership seek broader 
input on issues that emerge through research and teacher accounts. This information 
is used to inform decisions and discussions of focus groups, task forces, and 
committees as they use the assembled data, along with their own experiences, to 
construct new programs and materials and to strengthen existing training programs. 

In this way. Foxfire’s work remains teacher-focused, clearfy and powerfully coimeaed 
to the work and lives of practicing teachers. Because of its dynamic nature, the 
Approach can meet emerging trends and challenges while remaining true to the tenets 
articulated by the Core Practices. 



October 8, 1998 




Becki Herman 
Project Director 

American Institutes for Research 
1000 Thomas Jefferson Street, N.W. 

Washington, DC 20007 

Dear Becki; 

I appreciate your continued attention and responsiveness to the many 
comments and concerns about the draft report “Judging Schoolwide Reform: A 
Teacher And Administrator Guide to 26 Noteworthy Approaches”. In talking with 
other folks in the field, I continued to be concerned that your analysis rendered us 
with “no acceptable research” when other accepted articles seemed less credible 
than the documentation we have from state tests administered in MRSh schools. 

Given the interest of bur school districts in performance on state tests, we 
have come to rely almost exclusively on thpse results to evaluate our success. 

This data is public and thus, available for anyone to corroborate. We use state 
(when only one school is in the district) or district scores as comparison groups 
and assess rates of growth in those meeting state standards (whenever we can get 
that data). I am enclosing for you all of the 1997-98 data we have. It is inclusive 
of all elementary schools we work with except for Seattle (where we have one 
school) and Maryland (where we have 1 1 schools). In the case of Maryland, the 
data has yet to be made publicly available. 

I would consider our data meeting more rigorous standards and of greater 
interest to your readers than much of what has counted as research in your 
compendium and respectfully request you reconsider your evaluation. My claim is 
simply that our data is collected by an agency completely independent of this 
organization, rather than a test that is designed by us but not by state or local 
officials. Moreover, comparison of growth rates does control for different starting 
points and thus approximates a control group comparison better than raw score 
data. 



Modern Red Schoolhouse Institute 
208 23rd Avenue. North 
Nashville, Tennessee 37203 
615-320-8804* FAX 615-320-5366 
For Information Call 888-ASK-MRSH 
WeiD Site: www.mrsh.org 



434 



Becki Herman 
October 8, 1998 
Page Two 



Furthermore, the ability of any researcher to validate our analysis is far 
better than tests designed and collected by a researcher. Since the state test score 
data is publicly available data, the research analysis can be replicated or 
reanalyzed — a condition not met with “private” tests often published in peer 
reviewed journals. 

I sincerely appreciate the challenges that you are encountering with so 
many folks “bending your ear” and greatly appreciate your patience and attention. 
If any other information would be useful to you, please let me know. 



Sincerely, 




President 



October 5, 1998 



Paideia 

Terry Roberts, The National Paideia Center 



Our work is increasingly focused on developing networks of Paideia schools in partnership 
school districts (notably Guilford County, NC and Broward County, FL). We are pursuing 
this strategy in order to created supportive networks of schools dedicated to school-wide 
Paideia implementation 



October 28, 1998 



Success for All and Roots and Wings 

Dr. Robert Slavin, Johns Hopkins University 

The profile of Success for All in "Judging Schoolwide Reform" is mostly a good description of 
the program and the research done on it. However, there are several areas in which clarification is 
needed. 

First, the final paragraph on implementation problems is misleading. It is true that some schools 
have had difficulties in the long run maintaining adequate numbers of tutors and family support staff. 
This is an issue schools struggle with as Title I funds go up and down. However, almost every one of 
our schools has maintained the reading programs, the regrouping, a full-time facilitator, and the eight- 
week assessments. Modifications may be made in these over time, but these core elements exist in 
virtually every one of the schools we currently work with, even schools in their tenth implementation 
year. Also, it is important to note that both of the Rand implementation studies by Sue Bodilly found 
Roots & Wings (and therefore Success for All) to be the most completely implemented of the New 
American Schools designs. About two dozen schools have completely dropped the program, which is a 
different story, but that is about 2 % of all school that have ever been involved, a remarkable 
achievement by any standard. 

Another misleading section related to costs. The profile gives the costs as we do, about $70,000 
in the first year, $30,000 in the second, and $20,000 in the third, for materials, training, travel and so on. 
However, it then gives much higher costs, including personnel. These are accurate in one sense, but 
misleading, because no school has ever hired hundreds of thousands of dollars worth of new staff to 
implement Success for All. Instead, schools reallocate existing staff, mostly from Title I, state 
compensatory education, special education, and bilingual/ESL resources, to provide the required 
facilitator and tutors. To describe these as extra staff is incorrect. If a school was spending $200,000 per 
year on Title I staff, then adopts Success for All, and is still spending $200,000 on Title I staff, would 
the staff cost of Success for All be $200,000? Obviously not. The additional staff cost due to Success 
for All would be zero. If that same school chose a model that did not require any change in the roles of 
Title I staff, or made no change at all, it would still have $200,000 in Title I staff. 

The description of research on Success for All is generally accurate. However, it would be 
important to note that the two main studies of Roots & Wings also demonstrated substantially positive 
impacts on reading, writing, and language arts on state assessments (one in Maryland, one in 
Tennessee). These effects can reasonably be ascribed to Success for All, which is the 
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reading/writing/language component of Roots & Wings. The Tennessee study is particularly important 
in this regard, as it was a completely independent evaluation carried out by William Sanders, creator of 
the highly regarded Tennessee Value-Added Assessment System. Sanders compared eight Memphis 
Roots & Wings schools to matched controls and to other Memphis schools on a measure comparing 
actual to expected gain. After two years, R&W scores for reading were 128% of expected gain, 
compared to 93% for matched controls and 101% for other Memphis schools. In language, the scores 
were 126% of expected gains for R&W, 99% for controls, and 100% for other schools. 
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Urban Learning Centers 

A New American SchooLf Design 



October 28, 1998 



Ms. Becki Herman 
Pelavin Research Center 
1000 Thomas Jefferson Street, N.W. 
Washington, D.C. 20007 

Dear Ms. Herman: 



Backgroxmd. The Urban Learning Centers design for comprehensive reform has a heart and 
the heart of its work is to create commxmities in schools which lead to the high achievenient 
and learfiing of every child. Children in urban settings are sometimes left alone without a 
community or family support system. Urban schools are often large, without a common 
vision or commxmication among teachers about their goals for students. Sometimes those 
schools are isolated from services available to assist children and their families with their 
needs. Building commxmity on all of these fronts is essential in the work of Urban Learning 
Centers. 

We know from studies of schoolwide reform and research on child development that for 
schools to succeed in low-income, urban areas they must address teaching and learning in 
new ways, plus have a foundation of quality management practices and inclusive gover- 
nance systems that involve all of the staff and parents in a common vision for success. In 
addition, children in urban settings and their families may need additional supports for 
learning which involve the school forming partnerships with health and social service 
agencies in the community. If you want to ensure student success, you need to engage a 
platoon of supporters to assist you in your work. 



Effects on Students. Our research tells us we are on the right track. Here is the good news: 
As of 1997, as both model Learning Centers grew to K-12 campuses they reduced rates of 
both teacher and student absenteeism. Transience; of students at one site was reduced 30% 
over four years. 



Achievements at both high schools are impressive. They demonstrated high attendance, 
strong grade-point averages and very low dropout rates (6% compared with 28% in Los 
Angeles). Nearly 100% of the seniors graduated on schedule and all went on to post- 
secondary education or the armed forces, 95% went on to college. In fact, 14% of the stu- 
dents at one school and 12% at the other plarmed to attend the University of California, 
placing tl\C high schools among the top 25% of all schools as measured by the High Schools 
Performance Report of the California Department of Education. SAT scores were above 
those in neighboring schools. At Foshay, 27% of the juniors scored above 1000, close to the 
national average of 1013. 
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Parent presence at both schools is up dramatically. In the past, parents of students at Elizabeth 
Learning Center came on campus solely for special occasions. Now, more than 1,000 parents and 
others attend adult education classes there each week. Parents and community members volunteer 
over 12,000 hours each year. 

Two years ago, Los Angeles Unified School District switched norm-referenced tests. In the past two 
years of Stanford Nine test administration at each site, nearly all scores in reading, math and lan- 
guage have increased. At Foshay, middle school achievement in reading (nearly 800 students per 
grade in 6th, 7th, and 8th grade) on the Stanford test is nearly double the score at the neighboring 
middle school. 

Implementation. The cost of the Urban Learning Centers design varies according to the size of the 
school. Orientation to model, conducting a self-study and mapping the resources of the school can 
be completed over a 3-6 month period for $30,000. Full implementation of years of design compo- 
nents ranges from $60,000 to $75,000 for schools with 60 to 100 teachers respectively. An Urban 
Learning Centers Site Director and a technical assistance team work with the school to plan and 
conduct professional development restructure governance and management systems as needed, 
and recruit community resources to support learning. Planning how to use technology effectively 
to enhance learning and improve efficiency, plus improving communications at the school, are also 
part of the work accomplished during implementation. 

Schools which will benefit most from selecting the Urban Learning Centers design are those which 
are looking for a comprehensive approach to reform which will sustain continuous improvement. 
They are schools seeking to teach students using high standards for all subject areas and are willing 
to regularly use data to assess the achievements of children. Large schools in which children are 
not yet succeeding at high levels and in which size makes commimication difficult may gain the 
most from this approach to reform. Urban Learning Centers works with them to create commimi- 
ties for all learners including children, their parents and families, and the educators at the school. 

We welcome visitors to oiir two model sites in central Los Angeles. 

Yours very truly. 



Greta S. Pruitt, Project Director 
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